Max level shown:
1 [ Jan 30 20:17:20 Enabled. ]
2 [ Jan 30 20:17:20 Rereading configuration. ]
3 [ Jan 30 20:17:22 Rereading configuration. ]
4 [ Jan 30 20:17:28 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Jan 30 20:17:28 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72025-01-30T20:17:29.006ZDEBGnexus: registered DTrace probes
82025-01-30T20:17:29.010ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:78
92025-01-30T20:17:29.018ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102025-01-30T20:17:29.018ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112025-01-30T20:17:29.018ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122025-01-30T20:17:29.018ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132025-01-30T20:17:29.018ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142025-01-30T20:17:29.018ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152025-01-30T20:17:29.018ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162025-01-30T20:17:29.018ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = AffinityGroup file = nexus/auth/src/authz/oso_generic.rs:68
282025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = AntiAffinityGroup file = nexus/auth/src/authz/oso_generic.rs:68
292025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
302025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
312025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
322025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
332025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
342025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
352025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
362025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
372025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
382025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
392025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
402025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
412025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
422025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
432025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
442025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
452025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
462025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
472025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
482025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
492025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
502025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
512025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
522025-01-30T20:17:29.019ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
532025-01-30T20:17:29.020ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
542025-01-30T20:17:29.020ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
552025-01-30T20:17:29.020ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
562025-01-30T20:17:29.020ZINFOnexus (ServerContext): registering Oso class class = SupportBundle file = nexus/auth/src/authz/oso_generic.rs:68
572025-01-30T20:17:29.020ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
582025-01-30T20:17:29.020ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
592025-01-30T20:17:29.020ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
602025-01-30T20:17:29.020ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
612025-01-30T20:17:29.020ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
622025-01-30T20:17:29.020ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
632025-01-30T20:17:29.020ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
642025-01-30T20:17:29.020ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
652025-01-30T20:17:29.020ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource AffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AffinityGroup)\n if child.project = parent;\n \n\n resource AntiAffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AntiAffinityGroup)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n resource SupportBundle {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SupportBundle)\n if child.fleet = fleet;\n \n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
662025-01-30T20:17:29.036ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
672025-01-30T20:17:29.039ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
682025-01-30T20:17:29.044ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
692025-01-30T20:17:29.050ZDEBGnexus (ServerContext): registered USDT probes
702025-01-30T20:17:29.092ZINFOnexus: Database schema version is up to date desired_version = 123.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 123.0.0
712025-01-30T20:17:29.097ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
722025-01-30T20:17:29.098ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2200, tv_nsec: 309151790 } })
732025-01-30T20:17:29.101ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1155
742025-01-30T20:17:29.151ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
752025-01-30T20:17:29.151ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
762025-01-30T20:17:29.156ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a81a42a-c0a2-4cba-adcc-97a4949a2d49", "content-length": "26", "date": "Thu, 30 Jan 2025 20:17:28 GMT"} })
772025-01-30T20:17:29.156ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
782025-01-30T20:17:29.156ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
792025-01-30T20:17:29.187ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2200, tv_nsec: 397448370 } })
802025-01-30T20:17:29.187ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1155
812025-01-30T20:17:29.219ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
822025-01-30T20:17:29.219ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
832025-01-30T20:17:29.219ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a999170-71cb-41a0-9fec-b590dff0afbe", "content-length": "26", "date": "Thu, 30 Jan 2025 20:17:28 GMT"} })
842025-01-30T20:17:29.219ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
852025-01-30T20:17:29.219ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
862025-01-30T20:17:29.286ZDEBGnexus (clickhouse-client): registered USDT probes id = d8139e97-120a-4b80-a214-21ad1df46dca
872025-01-30T20:17:29.299ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
882025-01-30T20:17:29.310ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
892025-01-30T20:17:29.312ZDEBGnexus (DataLoader): attempting to create built-in users
902025-01-30T20:17:29.313ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
912025-01-30T20:17:29.313ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
922025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks versions = all
932025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate versions = all
942025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
952025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /clickhouse/policy versions = all
962025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /clickhouse/policy versions = all
972025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
982025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
992025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
1002025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
1012025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1022025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga versions = all
1032025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1042025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all versions = all
1052025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1062025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1072025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import versions = all
1082025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1092025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target versions = all
1102025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target versions = all
1112025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1122025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1132025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id} versions = all
1142025-01-30T20:17:29.333ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1152025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors versions = all
1162025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1172025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers versions = all
1182025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1192025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge versions = all
1202025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled} versions = all
1212025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1222025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas versions = all
1232025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id} versions = all
1242025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1252025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1262025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1272025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add versions = all
1282025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge versions = all
1292025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized versions = all
1302025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id} versions = all
1312025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1322025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1332025-01-30T20:17:29.334ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::c]:12221
1342025-01-30T20:17:29.334ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1352025-01-30T20:17:29.334ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1362025-01-30T20:17:29.337ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1372025-01-30T20:17:29.345ZWARNnexus: Cannot look up rack: Object (of type ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f)) not found: rack file = nexus/src/app/rack.rs:774
1382025-01-30T20:17:29.401ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1392025-01-30T20:17:29.401ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1402025-01-30T20:17:29.403ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1412025-01-30T20:17:29.403ZDEBGnexus (DataLoader): attempting to create built-in roles
1422025-01-30T20:17:29.403ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1432025-01-30T20:17:29.403ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1442025-01-30T20:17:29.516ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:84
1452025-01-30T20:17:29.516ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1462025-01-30T20:17:29.518ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1472025-01-30T20:17:29.518ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1482025-01-30T20:17:29.518ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1492025-01-30T20:17:29.518ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1502025-01-30T20:17:29.593ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:113
1512025-01-30T20:17:29.593ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1522025-01-30T20:17:29.595ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1532025-01-30T20:17:29.595ZDEBGnexus (DataLoader): attempting to create built-in silos
1542025-01-30T20:17:29.595ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1552025-01-30T20:17:29.595ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1562025-01-30T20:17:29.704ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:93
1572025-01-30T20:17:29.706ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1582025-01-30T20:17:29.707ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1592025-01-30T20:17:29.742ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1602025-01-30T20:17:29.743ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1612025-01-30T20:17:29.743ZDEBGnexus (DataLoader): attempting to create built-in projects
1622025-01-30T20:17:29.743ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1632025-01-30T20:17:29.743ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1642025-01-30T20:17:29.752ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1652025-01-30T20:17:29.752ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1662025-01-30T20:17:29.755ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1672025-01-30T20:17:29.755ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1682025-01-30T20:17:29.795ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692025-01-30T20:17:29.797ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1702025-01-30T20:17:29.797ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712025-01-30T20:17:29.797ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722025-01-30T20:17:29.837ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1732025-01-30T20:17:29.837ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1742025-01-30T20:17:29.880ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1752025-01-30T20:17:29.881ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1762025-01-30T20:17:29.881ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1772025-01-30T20:17:29.882ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1782025-01-30T20:17:29.910ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1792025-01-30T20:17:29.910ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1802025-01-30T20:17:29.911ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1812025-01-30T20:17:29.911ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1822025-01-30T20:17:29.911ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1832025-01-30T20:17:29.911ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1842025-01-30T20:17:29.914ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1852025-01-30T20:17:29.914ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1862025-01-30T20:17:29.916ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1872025-01-30T20:17:29.916ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1882025-01-30T20:17:29.917ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892025-01-30T20:17:29.917ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1902025-01-30T20:17:29.918ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912025-01-30T20:17:29.919ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1922025-01-30T20:17:29.920ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1932025-01-30T20:17:29.923ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1942025-01-30T20:17:29.923ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952025-01-30T20:17:29.923ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1962025-01-30T20:17:29.967ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972025-01-30T20:17:29.967ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982025-01-30T20:17:29.968ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1992025-01-30T20:17:29.969ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2002025-01-30T20:17:30.011ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2012025-01-30T20:17:30.014ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2022025-01-30T20:17:30.014ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032025-01-30T20:17:30.014ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042025-01-30T20:17:30.085ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052025-01-30T20:17:30.086ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2062025-01-30T20:17:30.087ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072025-01-30T20:17:30.087ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082025-01-30T20:17:30.089ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092025-01-30T20:17:30.089ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102025-01-30T20:17:30.091ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112025-01-30T20:17:30.094ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2122025-01-30T20:17:30.094ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132025-01-30T20:17:30.094ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2142025-01-30T20:17:30.126ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2152025-01-30T20:17:30.127ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2162025-01-30T20:17:30.144ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172025-01-30T20:17:30.144ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2182025-01-30T20:17:30.154ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2192025-01-30T20:17:30.154ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2202025-01-30T20:17:30.156ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2212025-01-30T20:17:30.156ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2222025-01-30T20:17:30.158ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2232025-01-30T20:17:30.158ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2242025-01-30T20:17:30.159ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2252025-01-30T20:17:30.160ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2262025-01-30T20:17:30.161ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2272025-01-30T20:17:30.161ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2282025-01-30T20:17:30.162ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292025-01-30T20:17:30.166ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2302025-01-30T20:17:30.166ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2312025-01-30T20:17:30.166ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2322025-01-30T20:17:30.168ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2332025-01-30T20:17:30.168ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2342025-01-30T20:17:30.169ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2352025-01-30T20:17:30.169ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2362025-01-30T20:17:30.170ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2372025-01-30T20:17:30.173ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2382025-01-30T20:17:30.173ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2392025-01-30T20:17:30.173ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2402025-01-30T20:17:30.231ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2412025-01-30T20:17:30.231ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2422025-01-30T20:17:30.232ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2432025-01-30T20:17:30.233ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2442025-01-30T20:17:30.234ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2452025-01-30T20:17:30.235ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2462025-01-30T20:17:30.237ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2472025-01-30T20:17:30.240ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2482025-01-30T20:17:30.240ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2492025-01-30T20:17:30.240ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2502025-01-30T20:17:30.343ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2512025-01-30T20:17:30.343ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522025-01-30T20:17:30.343ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532025-01-30T20:17:30.345ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542025-01-30T20:17:30.345ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2552025-01-30T20:17:30.360ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562025-01-30T20:17:30.360ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2572025-01-30T20:17:30.375ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2582025-01-30T20:17:30.375ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2592025-01-30T20:17:30.376ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2602025-01-30T20:17:30.377ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2612025-01-30T20:17:30.378ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2622025-01-30T20:17:30.378ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2632025-01-30T20:17:30.380ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2642025-01-30T20:17:30.383ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2652025-01-30T20:17:30.383ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2662025-01-30T20:17:30.383ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2672025-01-30T20:17:30.384ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2682025-01-30T20:17:30.384ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2692025-01-30T20:17:30.386ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2702025-01-30T20:17:30.386ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2712025-01-30T20:17:30.387ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2722025-01-30T20:17:30.390ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2732025-01-30T20:17:30.390ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2742025-01-30T20:17:30.390ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2752025-01-30T20:17:30.409ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2762025-01-30T20:17:30.409ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2772025-01-30T20:17:30.411ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2782025-01-30T20:17:30.411ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2792025-01-30T20:17:30.412ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2802025-01-30T20:17:30.413ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2812025-01-30T20:17:30.414ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2822025-01-30T20:17:30.417ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2832025-01-30T20:17:30.417ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2842025-01-30T20:17:30.417ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2852025-01-30T20:17:30.494ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
2862025-01-30T20:17:30.494ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2872025-01-30T20:17:30.494ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2882025-01-30T20:17:30.494ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2892025-01-30T20:17:30.503ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2902025-01-30T20:17:30.503ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2912025-01-30T20:17:30.504ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2922025-01-30T20:17:30.505ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2932025-01-30T20:17:30.506ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2942025-01-30T20:17:30.507ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2952025-01-30T20:17:30.508ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2962025-01-30T20:17:30.509ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2972025-01-30T20:17:30.510ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2982025-01-30T20:17:30.510ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2992025-01-30T20:17:30.511ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3002025-01-30T20:17:30.514ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3012025-01-30T20:17:30.514ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3022025-01-30T20:17:30.514ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3032025-01-30T20:17:30.526ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3042025-01-30T20:17:30.526ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3052025-01-30T20:17:30.527ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3062025-01-30T20:17:30.527ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3072025-01-30T20:17:30.528ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3082025-01-30T20:17:30.529ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3092025-01-30T20:17:30.531ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3102025-01-30T20:17:30.531ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3112025-01-30T20:17:30.532ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3122025-01-30T20:17:30.532ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3132025-01-30T20:17:30.533ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3142025-01-30T20:17:30.533ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3152025-01-30T20:17:30.535ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3162025-01-30T20:17:30.539ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3172025-01-30T20:17:30.539ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3182025-01-30T20:17:30.539ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192025-01-30T20:17:30.541ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3202025-01-30T20:17:30.541ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3212025-01-30T20:17:30.544ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3222025-01-30T20:17:30.544ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3232025-01-30T20:17:30.545ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3242025-01-30T20:17:30.545ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3252025-01-30T20:17:30.547ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3262025-01-30T20:17:30.550ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3272025-01-30T20:17:30.593ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3282025-01-30T20:17:30.593ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292025-01-30T20:17:30.791ZERROnexus (DataLoader): gave up trying to populate built-in PopulateBuiltinVpcs error_message = InternalError { internal_message: "unexpected database error: Record not found" } file = nexus/src/populate.rs:126
3302025-01-30T20:17:30.791ZERROnexus: populate failed file = nexus/src/app/mod.rs:548
3312025-01-30T20:17:30.791ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:554
3322025-01-30T20:17:30.800ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
3332025-01-30T20:17:30.800ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
3342025-01-30T20:17:30.800ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
3352025-01-30T20:17:30.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
3362025-01-30T20:17:30.800ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
3372025-01-30T20:17:30.800ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
3382025-01-30T20:17:30.800ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 1 reason = Timeout
3392025-01-30T20:17:30.800ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
3402025-01-30T20:17:30.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
3412025-01-30T20:17:30.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
3422025-01-30T20:17:30.800ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3432025-01-30T20:17:30.800ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
3442025-01-30T20:17:30.801ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3452025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
3462025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
3472025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
3482025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
3492025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3502025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
3512025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
3522025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
3532025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
3542025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
3552025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
3562025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
3572025-01-30T20:17:30.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:07:30.801013252 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3582025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
3592025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3602025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
3612025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3622025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
3632025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3642025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
3652025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
3662025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 1 reason = Timeout
3672025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
3682025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
3692025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
3702025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
3712025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
3722025-01-30T20:17:30.801ZWARNnexus (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous file = nexus/src/app/background/tasks/blueprint_rendezvous.rs:52 reason = no blueprint
3732025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
3742025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
3752025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
3762025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 1 reason = Timeout
3772025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3782025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3792025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3802025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
3812025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
3822025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
3832025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3842025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
3852025-01-30T20:17:30.801ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
3862025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
3872025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3882025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
3892025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
3902025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3912025-01-30T20:17:30.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:71 reason = no blueprint
3922025-01-30T20:17:30.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
3932025-01-30T20:17:30.801ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
3942025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3952025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3962025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3972025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 59.961\u{b5}s iteration = 1 status = {"error":"no blueprint"}
3982025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 238.636\u{b5}s iteration = 1 status = {"error":"no blueprint"}
3992025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 221.297\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4002025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 177.855\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4012025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4022025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4032025-01-30T20:17:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4042025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4052025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4062025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4072025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4082025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4092025-01-30T20:17:30.802ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4102025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 896.535\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4112025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4122025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4132025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
4142025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4152025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4162025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
4172025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4182025-01-30T20:17:30.802ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4192025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4202025-01-30T20:17:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4212025-01-30T20:17:30.803ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2202, tv_nsec: 13281086 } })
4222025-01-30T20:17:30.803ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2202, tv_nsec: 13512352 } })
4232025-01-30T20:17:30.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4242025-01-30T20:17:30.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4252025-01-30T20:17:30.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4262025-01-30T20:17:30.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4272025-01-30T20:17:30.805ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4282025-01-30T20:17:30.805ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4292025-01-30T20:17:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.516396ms iteration = 1 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
4302025-01-30T20:17:30.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4312025-01-30T20:17:30.805ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4322025-01-30T20:17:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.417003ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4332025-01-30T20:17:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 2.72\u{b5}s iteration = 2 status = {"error":"no config"}
4342025-01-30T20:17:30.805ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4352025-01-30T20:17:30.805ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4362025-01-30T20:17:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 7.11\u{b5}s iteration = 2 status = {"error":"no config"}
4372025-01-30T20:17:30.805ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4382025-01-30T20:17:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4392025-01-30T20:17:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4402025-01-30T20:17:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4412025-01-30T20:17:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4422025-01-30T20:17:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4432025-01-30T20:17:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4442025-01-30T20:17:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4452025-01-30T20:17:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4462025-01-30T20:17:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4472025-01-30T20:17:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4482025-01-30T20:17:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4492025-01-30T20:17:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4502025-01-30T20:17:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4512025-01-30T20:17:30.808ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4522025-01-30T20:17:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4532025-01-30T20:17:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
4542025-01-30T20:17:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4552025-01-30T20:17:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4562025-01-30T20:17:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4572025-01-30T20:17:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4582025-01-30T20:17:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4592025-01-30T20:17:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4602025-01-30T20:17:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4612025-01-30T20:17:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4622025-01-30T20:17:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
4632025-01-30T20:17:30.809ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4642025-01-30T20:17:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
4652025-01-30T20:17:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4662025-01-30T20:17:30.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4672025-01-30T20:17:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
4682025-01-30T20:17:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4692025-01-30T20:17:30.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4702025-01-30T20:17:30.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4712025-01-30T20:17:30.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4722025-01-30T20:17:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4732025-01-30T20:17:30.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4742025-01-30T20:17:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4752025-01-30T20:17:30.833ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4762025-01-30T20:17:30.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4772025-01-30T20:17:30.835ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4782025-01-30T20:17:30.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4792025-01-30T20:17:30.855ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:07:30.801013252 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
4802025-01-30T20:17:30.855ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 55.163701ms iteration = 1 status = {"expiration":"2025-01-30T20:07:30.801013252Z","pruned":[]}
4812025-01-30T20:17:30.857ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4822025-01-30T20:17:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4832025-01-30T20:17:30.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4842025-01-30T20:17:30.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4852025-01-30T20:17:30.866ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 65.293082ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
4862025-01-30T20:17:30.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4872025-01-30T20:17:30.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4882025-01-30T20:17:30.882ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4892025-01-30T20:17:30.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
4902025-01-30T20:17:30.885ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4912025-01-30T20:17:30.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4922025-01-30T20:17:30.908ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4932025-01-30T20:17:30.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4942025-01-30T20:17:30.908ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 107.832823ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
4952025-01-30T20:17:30.909ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2202, tv_nsec: 119849504 } })
4962025-01-30T20:17:30.909ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4972025-01-30T20:17:30.910ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
4982025-01-30T20:17:30.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4992025-01-30T20:17:30.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5002025-01-30T20:17:30.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5012025-01-30T20:17:30.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
5022025-01-30T20:17:30.911ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
5032025-01-30T20:17:30.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5042025-01-30T20:17:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
5052025-01-30T20:17:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5062025-01-30T20:17:30.912ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5072025-01-30T20:17:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5082025-01-30T20:17:30.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5092025-01-30T20:17:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5102025-01-30T20:17:30.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5112025-01-30T20:17:30.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5122025-01-30T20:17:30.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5132025-01-30T20:17:30.918ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5142025-01-30T20:17:30.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5152025-01-30T20:17:30.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5162025-01-30T20:17:30.920ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
5172025-01-30T20:17:30.920ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 119.883097ms iteration = 1 status = {"error":"rack not yet initialized: 6cd2152b-e0e7-4208-8446-3b1ba878a49f"}
5182025-01-30T20:17:30.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5192025-01-30T20:17:30.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5202025-01-30T20:17:30.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5212025-01-30T20:17:30.922ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5222025-01-30T20:17:30.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5232025-01-30T20:17:30.926ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5242025-01-30T20:17:30.926ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5252025-01-30T20:17:30.926ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 125.36613ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5262025-01-30T20:17:30.926ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2202, tv_nsec: 136994199 } })
5272025-01-30T20:17:30.927ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
5282025-01-30T20:17:30.928ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5292025-01-30T20:17:30.929ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
5302025-01-30T20:17:30.929ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
5312025-01-30T20:17:30.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
5322025-01-30T20:17:30.935ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5332025-01-30T20:17:30.936ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5342025-01-30T20:17:30.936ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 135.332206ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
5352025-01-30T20:17:30.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5362025-01-30T20:17:30.936ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5372025-01-30T20:17:30.937ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 135.798169ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5382025-01-30T20:17:30.937ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5392025-01-30T20:17:30.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5402025-01-30T20:17:30.938ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 137.222139ms iteration = 1 status = {"errors":[],"finish_invoked_ok":[]}
5412025-01-30T20:17:30.940ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5422025-01-30T20:17:30.941ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 139.937544ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5432025-01-30T20:17:30.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5442025-01-30T20:17:30.944ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5452025-01-30T20:17:30.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5462025-01-30T20:17:30.946ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5472025-01-30T20:17:30.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5482025-01-30T20:17:30.950ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5492025-01-30T20:17:30.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5502025-01-30T20:17:30.952ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5512025-01-30T20:17:30.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5522025-01-30T20:17:30.956ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5532025-01-30T20:17:30.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5542025-01-30T20:17:30.957ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
5552025-01-30T20:17:30.957ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 156.218266ms iteration = 1 status = {"error":"inventory collection is None"}
5562025-01-30T20:17:30.958ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5572025-01-30T20:17:30.958ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5582025-01-30T20:17:30.958ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5592025-01-30T20:17:30.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5602025-01-30T20:17:30.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5612025-01-30T20:17:30.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5622025-01-30T20:17:30.960ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5632025-01-30T20:17:30.960ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 159.334752ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5642025-01-30T20:17:30.960ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5652025-01-30T20:17:30.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5662025-01-30T20:17:30.961ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5672025-01-30T20:17:30.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5682025-01-30T20:17:30.966ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5692025-01-30T20:17:30.968ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
5702025-01-30T20:17:30.968ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5712025-01-30T20:17:30.968ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9eb8cb9-ff23-4af1-9cf1-642b6b17efc3", "content-length": "26", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
5722025-01-30T20:17:30.969ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5732025-01-30T20:17:30.970ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5742025-01-30T20:17:30.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5752025-01-30T20:17:30.972ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5762025-01-30T20:17:30.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5772025-01-30T20:17:30.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5782025-01-30T20:17:30.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5792025-01-30T20:17:30.976ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5802025-01-30T20:17:30.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5812025-01-30T20:17:30.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5822025-01-30T20:17:30.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5832025-01-30T20:17:30.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5842025-01-30T20:17:30.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5852025-01-30T20:17:30.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5862025-01-30T20:17:30.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5872025-01-30T20:17:30.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5882025-01-30T20:17:30.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5892025-01-30T20:17:30.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5902025-01-30T20:17:30.986ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5912025-01-30T20:17:30.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5922025-01-30T20:17:30.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5932025-01-30T20:17:30.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5942025-01-30T20:17:30.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5952025-01-30T20:17:30.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5962025-01-30T20:17:30.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5972025-01-30T20:17:30.990ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5982025-01-30T20:17:30.991ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5992025-01-30T20:17:30.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6002025-01-30T20:17:30.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6012025-01-30T20:17:30.992ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6022025-01-30T20:17:30.992ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6032025-01-30T20:17:30.992ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 191.67232ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6042025-01-30T20:17:30.994ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 193.594913ms iteration = 1 status = {}
6052025-01-30T20:17:30.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6062025-01-30T20:17:31.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6072025-01-30T20:17:31.000ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6082025-01-30T20:17:31.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6092025-01-30T20:17:31.002ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6102025-01-30T20:17:31.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6112025-01-30T20:17:31.002ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
6122025-01-30T20:17:31.002ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6132025-01-30T20:17:31.003ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "360e8778-b617-447f-977e-259cfc42d5be", "content-length": "26", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
6142025-01-30T20:17:31.003ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6152025-01-30T20:17:31.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6162025-01-30T20:17:31.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6172025-01-30T20:17:31.005ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6182025-01-30T20:17:31.007ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6192025-01-30T20:17:31.007ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 206.124611ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6202025-01-30T20:17:31.009ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6212025-01-30T20:17:31.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 208.482546ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6222025-01-30T20:17:31.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6232025-01-30T20:17:31.012ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6242025-01-30T20:17:31.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6252025-01-30T20:17:31.013ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6262025-01-30T20:17:31.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6272025-01-30T20:17:31.014ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6282025-01-30T20:17:31.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6292025-01-30T20:17:31.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6302025-01-30T20:17:31.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6312025-01-30T20:17:31.017ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
6322025-01-30T20:17:31.017ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2202, tv_nsec: 228138379 } })
6332025-01-30T20:17:31.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6342025-01-30T20:17:31.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
6352025-01-30T20:17:31.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6362025-01-30T20:17:31.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6372025-01-30T20:17:31.024ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6382025-01-30T20:17:31.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6392025-01-30T20:17:31.026ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6402025-01-30T20:17:31.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6412025-01-30T20:17:31.026ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 225.53917ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6422025-01-30T20:17:31.028ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6432025-01-30T20:17:31.028ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6442025-01-30T20:17:31.028ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6452025-01-30T20:17:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6462025-01-30T20:17:31.033ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6472025-01-30T20:17:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
6482025-01-30T20:17:31.035ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6492025-01-30T20:17:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6502025-01-30T20:17:31.037ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
6512025-01-30T20:17:31.037ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 237.055029ms iteration = 1 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
6522025-01-30T20:17:31.042ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6532025-01-30T20:17:31.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 243.614562ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6542025-01-30T20:17:31.045ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bb09ff4-b200-4436-8b35-17a67a30e2b4", "content-length": "1", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
6552025-01-30T20:17:31.046ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6562025-01-30T20:17:31.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6572025-01-30T20:17:31.055ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6582025-01-30T20:17:31.055ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 254.866744ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6592025-01-30T20:17:31.059ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6602025-01-30T20:17:31.059ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 258.146855ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6612025-01-30T20:17:31.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6622025-01-30T20:17:31.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6632025-01-30T20:17:31.062ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 261.860498ms iteration = 1 status = null
6642025-01-30T20:17:31.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 261.979971ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
6652025-01-30T20:17:31.063ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
6662025-01-30T20:17:31.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
6672025-01-30T20:17:31.064ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682025-01-30T20:17:31.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6692025-01-30T20:17:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
6702025-01-30T20:17:31.066ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
6712025-01-30T20:17:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
6722025-01-30T20:17:31.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
6732025-01-30T20:17:31.070ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6742025-01-30T20:17:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6752025-01-30T20:17:31.073ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
6762025-01-30T20:17:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 272.773161ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
6772025-01-30T20:17:31.075ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 273.957433ms iteration = 1 status = {"last_run_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":0,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":0,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[]}
6782025-01-30T20:17:31.077ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 276.33172ms iteration = 1 status = {}
6792025-01-30T20:17:31.089ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6802025-01-30T20:17:31.089ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6812025-01-30T20:17:31.089ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 288.212149ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6822025-01-30T20:17:31.090ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6832025-01-30T20:17:31.090ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6842025-01-30T20:17:31.090ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6852025-01-30T20:17:31.091ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "96ece638-a125-437a-b6a6-e5cad563f090", "content-length": "476", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
6862025-01-30T20:17:31.091ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 290.04173ms iteration = 1 status = {}
6872025-01-30T20:17:31.094ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6882025-01-30T20:17:31.094ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "74964a2d-f8d4-4168-96e5-41ba6f96565e", "content-length": "734", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
6892025-01-30T20:17:31.096ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6902025-01-30T20:17:31.097ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac09869c-e958-469a-84a7-0e81f75f45c2", "content-length": "111", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
6912025-01-30T20:17:31.098ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6922025-01-30T20:17:31.098ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b6730e6-22d8-4774-b2bd-41002030715b", "content-length": "111", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
6932025-01-30T20:17:31.098ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6942025-01-30T20:17:31.098ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8f205dc-bcef-45e0-bf4b-a71c4c7a5261", "content-length": "167", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
6952025-01-30T20:17:31.098ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6962025-01-30T20:17:31.099ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "72d3ff7d-0cf8-45c3-aa4c-a0581bce66b5", "content-length": "167", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
6972025-01-30T20:17:31.099ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6982025-01-30T20:17:31.099ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "11e6be35-fb72-4d54-a588-6dec39ea0f4f", "content-length": "175", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
6992025-01-30T20:17:31.099ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
7002025-01-30T20:17:31.099ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa3e5733-c492-4e49-920c-88c77c19ffdc", "content-length": "175", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7012025-01-30T20:17:31.099ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
7022025-01-30T20:17:31.101ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dc19db0-ca01-4b19-8bca-d6cdd5c88203", "content-length": "702", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7032025-01-30T20:17:31.101ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7042025-01-30T20:17:31.101ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7052025-01-30T20:17:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7062025-01-30T20:17:31.103ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7072025-01-30T20:17:31.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7082025-01-30T20:17:31.104ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3de21092-8d6d-47a7-be55-9a80c952a1a1", "content-length": "727", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7092025-01-30T20:17:31.104ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7102025-01-30T20:17:31.104ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7112025-01-30T20:17:31.105ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8308f5b6-a816-4eb9-bc0b-275940d1aa19", "content-length": "729", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7122025-01-30T20:17:31.105ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7132025-01-30T20:17:31.105ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bb8fe5f-2089-4ccb-8623-13a000578987", "content-length": "728", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7142025-01-30T20:17:31.105ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
7152025-01-30T20:17:31.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7162025-01-30T20:17:31.105ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "680fe81b-a7a6-4ac1-bba4-c34c2bfdd02f", "content-length": "722", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7172025-01-30T20:17:31.105ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
7182025-01-30T20:17:31.105ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "201e5b46-c191-4615-b69d-5a6ab9e651ab", "content-length": "109", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7192025-01-30T20:17:31.105ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
7202025-01-30T20:17:31.106ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "858d3220-94e1-49eb-99b3-13e34773c046", "content-length": "109", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7212025-01-30T20:17:31.106ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
7222025-01-30T20:17:31.106ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff7c0db1-744e-481a-aca7-4dc4f7d2d276", "content-length": "169", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7232025-01-30T20:17:31.106ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
7242025-01-30T20:17:31.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d4fa91d-dd96-4c37-99f6-e99461f51f9b", "content-length": "169", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7252025-01-30T20:17:31.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
7262025-01-30T20:17:31.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "741007e6-939b-44db-b53a-a6fc89b85224", "content-length": "178", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7272025-01-30T20:17:31.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7282025-01-30T20:17:31.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a69bfd36-747c-4db6-93fc-9cecf778b0e3", "content-length": "178", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7292025-01-30T20:17:31.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7302025-01-30T20:17:31.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6136a4fe-f041-4edd-822a-823f197afb32", "content-length": "702", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7312025-01-30T20:17:31.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7322025-01-30T20:17:31.107ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7332025-01-30T20:17:31.107ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5642e20e-3b9d-49b4-a8ba-87f35e7c5e88", "content-length": "727", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7342025-01-30T20:17:31.107ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7352025-01-30T20:17:31.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7362025-01-30T20:17:31.110ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7372025-01-30T20:17:31.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7382025-01-30T20:17:31.112ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "295ced9d-4d71-471a-a2d7-e13993986978", "content-length": "729", "date": "Thu, 30 Jan 2025 20:17:31 GMT"} })
7392025-01-30T20:17:31.112ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7402025-01-30T20:17:31.112ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4df16dc-297c-43ce-a5f5-e65a45ee1bcd", "content-length": "728", "date": "Thu, 30 Jan 2025 20:17:30 GMT"} })
7412025-01-30T20:17:31.112ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7422025-01-30T20:17:31.112ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7432025-01-30T20:17:31.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7442025-01-30T20:17:31.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7452025-01-30T20:17:31.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7462025-01-30T20:17:31.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7472025-01-30T20:17:31.114ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7482025-01-30T20:17:31.116ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7492025-01-30T20:17:31.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7502025-01-30T20:17:31.116ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7512025-01-30T20:17:31.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7522025-01-30T20:17:31.118ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7532025-01-30T20:17:31.120ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7542025-01-30T20:17:31.120ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7552025-01-30T20:17:31.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7562025-01-30T20:17:31.121ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7572025-01-30T20:17:31.121ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7582025-01-30T20:17:31.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7592025-01-30T20:17:31.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7602025-01-30T20:17:31.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7612025-01-30T20:17:31.126ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622025-01-30T20:17:31.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632025-01-30T20:17:31.128ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7642025-01-30T20:17:31.134ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7652025-01-30T20:17:31.134ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7662025-01-30T20:17:31.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7672025-01-30T20:17:31.166ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
7682025-01-30T20:17:31.167ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7692025-01-30T20:17:31.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7702025-01-30T20:17:31.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7712025-01-30T20:17:31.174ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
7722025-01-30T20:17:31.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7732025-01-30T20:17:31.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7742025-01-30T20:17:31.194ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
7752025-01-30T20:17:31.194ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
7762025-01-30T20:17:31.194ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
7772025-01-30T20:17:31.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7782025-01-30T20:17:31.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7792025-01-30T20:17:31.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7802025-01-30T20:17:31.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7812025-01-30T20:17:31.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7822025-01-30T20:17:31.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7832025-01-30T20:17:31.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7842025-01-30T20:17:31.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7852025-01-30T20:17:31.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7862025-01-30T20:17:31.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7872025-01-30T20:17:31.254ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7882025-01-30T20:17:31.254ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7892025-01-30T20:17:31.254ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7902025-01-30T20:17:31.256ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7912025-01-30T20:17:31.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7922025-01-30T20:17:31.258ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7932025-01-30T20:17:31.261ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7942025-01-30T20:17:31.261ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7952025-01-30T20:17:31.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7962025-01-30T20:17:31.345ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7972025-01-30T20:17:31.346ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7982025-01-30T20:17:31.352ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7992025-01-30T20:17:31.353ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8002025-01-30T20:17:31.355ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8012025-01-30T20:17:31.359ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
8022025-01-30T20:17:31.359ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:768
8032025-01-30T20:17:31.404ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 603.919822ms iteration = 1 status = {}
8042025-01-30T20:17:31.521ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8052025-01-30T20:17:31.522ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8062025-01-30T20:17:31.522ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8072025-01-30T20:17:31.522ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 720.518557ms
8082025-01-30T20:17:31.522ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 721.119565ms iteration = 1 status = {}
8092025-01-30T20:17:31.677ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = aa5f23fc-ea0f-42ec-bc7f-eadc53effff9 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
8102025-01-30T20:17:31.677ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = aa5f23fc-ea0f-42ec-bc7f-eadc53effff9 time_started = 2025-01-30 20:17:31.089505 UTC
8112025-01-30T20:17:31.677ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 876.779554ms iteration = 1 status = {"collection_id":"aa5f23fc-ea0f-42ec-bc7f-eadc53effff9","time_done":"2025-01-30 20:17:31.254577 UTC","time_started":"2025-01-30 20:17:31.089505 UTC"}
8122025-01-30T20:17:31.677ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 2 reason = Dependency
8132025-01-30T20:17:31.677ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8142025-01-30T20:17:31.677ZWARNnexus (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous file = nexus/src/app/background/tasks/blueprint_rendezvous.rs:52 reason = no blueprint
8152025-01-30T20:17:31.677ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 15.431\u{b5}s iteration = 2 status = {"error":"no blueprint"}
8162025-01-30T20:17:31.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8172025-01-30T20:17:31.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8182025-01-30T20:17:31.679ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8192025-01-30T20:17:31.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8202025-01-30T20:17:31.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8212025-01-30T20:17:31.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8222025-01-30T20:17:31.683ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
8232025-01-30T20:17:31.683ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 6.181902ms iteration = 2 status = {"error":"rack not yet initialized: 6cd2152b-e0e7-4208-8446-3b1ba878a49f"}
8242025-01-30T20:17:32.445ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:48750
8252025-01-30T20:17:32.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = 8d923437-b647-4c3a-b5d1-e128382f1102 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
8262025-01-30T20:17:32.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = 8d923437-b647-4c3a-b5d1-e128382f1102 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
8272025-01-30T20:17:32.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = 8d923437-b647-4c3a-b5d1-e128382f1102 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
8282025-01-30T20:17:32.919ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:41944
8292025-01-30T20:17:32.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 5c98911d-bc92-4509-85eb-1a76847280ce roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8302025-01-30T20:17:32.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 5c98911d-bc92-4509-85eb-1a76847280ce resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8312025-01-30T20:17:32.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 5c98911d-bc92-4509-85eb-1a76847280ce response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8322025-01-30T20:17:33.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a413416a-f1dc-45aa-8c39-c8be57eebf89 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8332025-01-30T20:17:33.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a413416a-f1dc-45aa-8c39-c8be57eebf89 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8342025-01-30T20:17:33.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a413416a-f1dc-45aa-8c39-c8be57eebf89 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8352025-01-30T20:17:33.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = db5499ef-3b6e-49ee-b9fd-aef1d885cdaa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8362025-01-30T20:17:33.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = db5499ef-3b6e-49ee-b9fd-aef1d885cdaa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8372025-01-30T20:17:33.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = db5499ef-3b6e-49ee-b9fd-aef1d885cdaa response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8382025-01-30T20:17:33.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 99cca4a5-a52e-4d6c-8cc8-bf92a77f1ea9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8392025-01-30T20:17:33.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 99cca4a5-a52e-4d6c-8cc8-bf92a77f1ea9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8402025-01-30T20:17:33.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 11084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 99cca4a5-a52e-4d6c-8cc8-bf92a77f1ea9 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8412025-01-30T20:17:33.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = f3a3fe8f-619a-4c3d-a2a3-18c6d7f9dbb5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8422025-01-30T20:17:33.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = f3a3fe8f-619a-4c3d-a2a3-18c6d7f9dbb5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8432025-01-30T20:17:33.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 16813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = f3a3fe8f-619a-4c3d-a2a3-18c6d7f9dbb5 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8442025-01-30T20:17:33.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 13a5cda0-7565-415d-bc42-b2ed5fdb1dc5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8452025-01-30T20:17:33.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 13a5cda0-7565-415d-bc42-b2ed5fdb1dc5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8462025-01-30T20:17:33.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 13a5cda0-7565-415d-bc42-b2ed5fdb1dc5 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8472025-01-30T20:17:33.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 124e1a70-dc3b-462c-a8d1-251e1fb82f4c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8482025-01-30T20:17:33.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 124e1a70-dc3b-462c-a8d1-251e1fb82f4c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8492025-01-30T20:17:33.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 124e1a70-dc3b-462c-a8d1-251e1fb82f4c response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8502025-01-30T20:17:33.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 1ad9c584-91f0-49cb-9ba9-ed075d91b2a9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8512025-01-30T20:17:33.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 1ad9c584-91f0-49cb-9ba9-ed075d91b2a9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8522025-01-30T20:17:33.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 1ad9c584-91f0-49cb-9ba9-ed075d91b2a9 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8532025-01-30T20:17:33.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a54c7024-47d8-4437-9d73-9cf6d6d8b5e6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8542025-01-30T20:17:33.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a54c7024-47d8-4437-9d73-9cf6d6d8b5e6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8552025-01-30T20:17:33.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a54c7024-47d8-4437-9d73-9cf6d6d8b5e6 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8562025-01-30T20:17:33.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 1a120709-0e4f-47db-87a5-ca2bf4c06333 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
8572025-01-30T20:17:33.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 1a120709-0e4f-47db-87a5-ca2bf4c06333 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
8582025-01-30T20:17:33.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 1a120709-0e4f-47db-87a5-ca2bf4c06333 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
8592025-01-30T20:17:33.360ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8602025-01-30T20:17:33.360ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8612025-01-30T20:17:33.362ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8622025-01-30T20:17:33.362ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8632025-01-30T20:17:33.364ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8642025-01-30T20:17:33.366ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
8652025-01-30T20:17:33.366ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8662025-01-30T20:17:35.367ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8672025-01-30T20:17:35.367ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8682025-01-30T20:17:35.369ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8692025-01-30T20:17:35.369ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8702025-01-30T20:17:35.371ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8712025-01-30T20:17:35.373ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
8722025-01-30T20:17:35.373ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8732025-01-30T20:17:37.374ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8742025-01-30T20:17:37.375ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8752025-01-30T20:17:37.376ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8762025-01-30T20:17:37.376ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8772025-01-30T20:17:37.378ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8782025-01-30T20:17:37.381ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
8792025-01-30T20:17:37.381ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8802025-01-30T20:17:39.381ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8812025-01-30T20:17:39.381ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8822025-01-30T20:17:39.383ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8832025-01-30T20:17:39.384ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8842025-01-30T20:17:39.385ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8852025-01-30T20:17:39.387ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
8862025-01-30T20:17:39.387ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8872025-01-30T20:17:40.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
8882025-01-30T20:17:40.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
8892025-01-30T20:17:40.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8902025-01-30T20:17:40.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8912025-01-30T20:17:40.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8922025-01-30T20:17:40.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8932025-01-30T20:17:40.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8942025-01-30T20:17:40.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8952025-01-30T20:17:40.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8962025-01-30T20:17:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8972025-01-30T20:17:40.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8982025-01-30T20:17:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8992025-01-30T20:17:40.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.361948ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9002025-01-30T20:17:40.914ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
9012025-01-30T20:17:40.914ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 113.951133ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
9022025-01-30T20:17:41.388ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9032025-01-30T20:17:41.389ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9042025-01-30T20:17:41.390ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9052025-01-30T20:17:41.390ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9062025-01-30T20:17:41.392ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9072025-01-30T20:17:41.394ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
9082025-01-30T20:17:41.395ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9092025-01-30T20:17:43.396ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9102025-01-30T20:17:43.396ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9112025-01-30T20:17:43.397ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9122025-01-30T20:17:43.397ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9132025-01-30T20:17:43.399ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9142025-01-30T20:17:43.402ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
9152025-01-30T20:17:43.402ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9162025-01-30T20:17:45.402ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9172025-01-30T20:17:45.403ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9182025-01-30T20:17:45.404ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9192025-01-30T20:17:45.404ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9202025-01-30T20:17:45.406ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9212025-01-30T20:17:45.408ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
9222025-01-30T20:17:45.408ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9232025-01-30T20:17:47.410ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9242025-01-30T20:17:47.410ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9252025-01-30T20:17:47.412ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9262025-01-30T20:17:47.412ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9272025-01-30T20:17:47.417ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9282025-01-30T20:17:47.420ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
9292025-01-30T20:17:47.420ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9302025-01-30T20:17:49.421ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9312025-01-30T20:17:49.421ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9322025-01-30T20:17:49.423ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9332025-01-30T20:17:49.423ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9342025-01-30T20:17:49.425ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9352025-01-30T20:17:49.428ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
9362025-01-30T20:17:49.428ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9372025-01-30T20:17:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
9382025-01-30T20:17:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
9392025-01-30T20:17:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9402025-01-30T20:17:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9412025-01-30T20:17:50.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9422025-01-30T20:17:50.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9432025-01-30T20:17:50.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9442025-01-30T20:17:50.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9452025-01-30T20:17:50.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9462025-01-30T20:17:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9472025-01-30T20:17:50.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9482025-01-30T20:17:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9492025-01-30T20:17:50.808ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
9502025-01-30T20:17:50.808ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 7.20728ms iteration = 3 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
9512025-01-30T20:17:50.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.946596ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9522025-01-30T20:17:51.430ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9532025-01-30T20:17:51.430ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9542025-01-30T20:17:51.431ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9552025-01-30T20:17:51.432ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9562025-01-30T20:17:51.433ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9572025-01-30T20:17:51.435ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
9582025-01-30T20:17:51.435ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9592025-01-30T20:17:53.436ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9602025-01-30T20:17:53.436ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9612025-01-30T20:17:53.438ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9622025-01-30T20:17:53.438ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9632025-01-30T20:17:53.440ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9642025-01-30T20:17:53.443ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
9652025-01-30T20:17:53.443ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9662025-01-30T20:17:55.443ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9672025-01-30T20:17:55.443ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9682025-01-30T20:17:55.445ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9692025-01-30T20:17:55.445ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9702025-01-30T20:17:55.447ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9712025-01-30T20:17:55.450ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
9722025-01-30T20:17:55.450ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9732025-01-30T20:17:57.450ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9742025-01-30T20:17:57.450ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9752025-01-30T20:17:57.452ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9762025-01-30T20:17:57.452ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9772025-01-30T20:17:57.454ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9782025-01-30T20:17:57.456ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
9792025-01-30T20:17:57.456ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9802025-01-30T20:17:59.458ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9812025-01-30T20:17:59.458ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9822025-01-30T20:17:59.459ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9832025-01-30T20:17:59.460ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9842025-01-30T20:17:59.462ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9852025-01-30T20:17:59.464ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
9862025-01-30T20:17:59.464ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9872025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
9882025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9892025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
9902025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9912025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
9922025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9932025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 2 reason = Timeout
9942025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
9952025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9962025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9972025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
9982025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
9992025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10002025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
10012025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
10022025-01-30T20:18:00.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10032025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10042025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10052025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
10062025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
10072025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10082025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10092025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
10102025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10112025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Timeout
10122025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10132025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
10142025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10152025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
10162025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10172025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
10182025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
10192025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10202025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
10212025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10222025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
10232025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10242025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10252025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10262025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10272025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10282025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10292025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10302025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10312025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10322025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10332025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10342025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10352025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10362025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10372025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10382025-01-30T20:18:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10392025-01-30T20:18:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10402025-01-30T20:18:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10412025-01-30T20:18:00.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10422025-01-30T20:18:00.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10432025-01-30T20:18:00.806ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10442025-01-30T20:18:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10452025-01-30T20:18:00.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10462025-01-30T20:18:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10472025-01-30T20:18:00.808ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2232, tv_nsec: 18632274 } })
10482025-01-30T20:18:00.808ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
10492025-01-30T20:18:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
10502025-01-30T20:18:00.809ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10512025-01-30T20:18:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10522025-01-30T20:18:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10532025-01-30T20:18:00.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10542025-01-30T20:18:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10552025-01-30T20:18:00.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10562025-01-30T20:18:00.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10572025-01-30T20:18:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10582025-01-30T20:18:00.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10592025-01-30T20:18:00.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10602025-01-30T20:18:00.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10612025-01-30T20:18:00.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10622025-01-30T20:18:00.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10632025-01-30T20:18:00.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 20.006726ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
10642025-01-30T20:18:00.821ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 19.995015ms iteration = 2 status = {}
10652025-01-30T20:18:00.822ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
10662025-01-30T20:18:00.822ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 20.709274ms iteration = 3 status = {"error":"rack not yet initialized: 6cd2152b-e0e7-4208-8446-3b1ba878a49f"}
10672025-01-30T20:18:00.823ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
10682025-01-30T20:18:00.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.031111ms iteration = 4 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
10692025-01-30T20:18:00.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10702025-01-30T20:18:00.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10712025-01-30T20:18:00.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10722025-01-30T20:18:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10732025-01-30T20:18:00.851ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
10742025-01-30T20:18:00.851ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10752025-01-30T20:18:00.853ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c43b5beb-7a4c-4b3b-b059-8236360a9997", "content-length": "26", "date": "Thu, 30 Jan 2025 20:18:00 GMT"} })
10762025-01-30T20:18:00.853ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10772025-01-30T20:18:00.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10782025-01-30T20:18:00.854ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10792025-01-30T20:18:00.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10802025-01-30T20:18:00.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10812025-01-30T20:18:00.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10822025-01-30T20:18:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10832025-01-30T20:18:00.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10842025-01-30T20:18:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10852025-01-30T20:18:00.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10862025-01-30T20:18:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10872025-01-30T20:18:00.860ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10882025-01-30T20:18:00.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10892025-01-30T20:18:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10902025-01-30T20:18:00.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.530513ms iteration = 2 status = {"errors":[],"finish_invoked_ok":[]}
10912025-01-30T20:18:00.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10922025-01-30T20:18:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10932025-01-30T20:18:00.869ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10942025-01-30T20:18:00.869ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.831473ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10952025-01-30T20:18:00.870ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10962025-01-30T20:18:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10972025-01-30T20:18:00.871ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10982025-01-30T20:18:00.872ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 71.390401ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10992025-01-30T20:18:00.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
11002025-01-30T20:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11012025-01-30T20:18:00.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11022025-01-30T20:18:00.874ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11032025-01-30T20:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11042025-01-30T20:18:00.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11052025-01-30T20:18:00.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11062025-01-30T20:18:00.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.719882ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11072025-01-30T20:18:00.880ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11082025-01-30T20:18:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11092025-01-30T20:18:00.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.13839ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11102025-01-30T20:18:00.893ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 92.579699ms iteration = 2 status = {}
11112025-01-30T20:18:00.912ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
11122025-01-30T20:18:00.913ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 111.70242ms iteration = 2 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
11132025-01-30T20:18:00.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.188054ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11142025-01-30T20:18:00.913ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2232, tv_nsec: 123915826 } })
11152025-01-30T20:18:00.913ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
11162025-01-30T20:18:00.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.568975ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
11172025-01-30T20:18:00.932ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 131.222922ms iteration = 2 status = {}
11182025-01-30T20:18:00.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11192025-01-30T20:18:00.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11202025-01-30T20:18:00.944ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
11212025-01-30T20:18:00.944ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11222025-01-30T20:18:00.944ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de1d5aaf-6ab0-493c-b224-7f9313c7d20b", "content-length": "26", "date": "Thu, 30 Jan 2025 20:18:00 GMT"} })
11232025-01-30T20:18:00.944ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11242025-01-30T20:18:00.945ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11252025-01-30T20:18:00.959ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11262025-01-30T20:18:00.959ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11272025-01-30T20:18:00.959ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11282025-01-30T20:18:00.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11292025-01-30T20:18:00.975ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11302025-01-30T20:18:00.975ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "12068dc6-3194-4cd4-91bf-c97623af01e9", "content-length": "1", "date": "Thu, 30 Jan 2025 20:18:00 GMT"} })
11312025-01-30T20:18:00.976ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11322025-01-30T20:18:00.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11332025-01-30T20:18:00.981ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 180.489359ms iteration = 2 status = null
11342025-01-30T20:18:00.990ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11352025-01-30T20:18:00.990ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11362025-01-30T20:18:00.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11372025-01-30T20:18:00.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11382025-01-30T20:18:01.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11392025-01-30T20:18:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11402025-01-30T20:18:01.041ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11412025-01-30T20:18:01.041ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11422025-01-30T20:18:01.041ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 240.431643ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11432025-01-30T20:18:01.065ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
11442025-01-30T20:18:01.065ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 263.74133ms iteration = 2 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
11452025-01-30T20:18:01.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11462025-01-30T20:18:01.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11472025-01-30T20:18:01.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11482025-01-30T20:18:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11492025-01-30T20:18:01.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11502025-01-30T20:18:01.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11512025-01-30T20:18:01.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11522025-01-30T20:18:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11532025-01-30T20:18:01.144ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 343.433282ms iteration = 2 status = {}
11542025-01-30T20:18:01.465ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11552025-01-30T20:18:01.465ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11562025-01-30T20:18:01.466ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11572025-01-30T20:18:01.467ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11582025-01-30T20:18:01.468ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11592025-01-30T20:18:01.471ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
11602025-01-30T20:18:01.471ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11612025-01-30T20:18:02.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = 4c7d17cc-5e1f-48b0-8b1c-48719df94825 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
11622025-01-30T20:18:02.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = 4c7d17cc-5e1f-48b0-8b1c-48719df94825 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
11632025-01-30T20:18:02.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = 4c7d17cc-5e1f-48b0-8b1c-48719df94825 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
11642025-01-30T20:18:03.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 3e5816ea-fbd3-42e0-bef0-2db8f1cc362c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
11652025-01-30T20:18:03.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 3e5816ea-fbd3-42e0-bef0-2db8f1cc362c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
11662025-01-30T20:18:03.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 3e5816ea-fbd3-42e0-bef0-2db8f1cc362c response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
11672025-01-30T20:18:03.472ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11682025-01-30T20:18:03.473ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11692025-01-30T20:18:03.474ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11702025-01-30T20:18:03.474ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11712025-01-30T20:18:03.476ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11722025-01-30T20:18:03.478ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
11732025-01-30T20:18:03.478ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11742025-01-30T20:18:05.479ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11752025-01-30T20:18:05.480ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11762025-01-30T20:18:05.481ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11772025-01-30T20:18:05.481ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11782025-01-30T20:18:05.483ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11792025-01-30T20:18:05.485ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
11802025-01-30T20:18:05.485ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11812025-01-30T20:18:07.487ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11822025-01-30T20:18:07.487ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11832025-01-30T20:18:07.489ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11842025-01-30T20:18:07.489ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11852025-01-30T20:18:07.491ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11862025-01-30T20:18:07.494ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
11872025-01-30T20:18:07.494ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11882025-01-30T20:18:09.179ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:62991
11892025-01-30T20:18:09.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62991 req_id = d8940bbc-83bc-4c40-bf15-e0d40bda52c7 roles = RoleSet { roles: {} } uri = /sled-agents/80be2cf5-c1f1-42e5-8353-289dd0bb621a
11902025-01-30T20:18:09.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62991 req_id = d8940bbc-83bc-4c40-bf15-e0d40bda52c7 resource = Database result = Ok(()) uri = /sled-agents/80be2cf5-c1f1-42e5-8353-289dd0bb621a
11912025-01-30T20:18:09.190ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "80be2cf5-c1f1-42e5-8353-289dd0bb621a" error_message_internal = not found: sled with id "80be2cf5-c1f1-42e5-8353-289dd0bb621a" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62991 req_id = d8940bbc-83bc-4c40-bf15-e0d40bda52c7 response_code = 404 uri = /sled-agents/80be2cf5-c1f1-42e5-8353-289dd0bb621a
11922025-01-30T20:18:09.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62991 req_id = 80eaee83-18d7-44a0-84fe-5013e117e7bf roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
11932025-01-30T20:18:09.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62991 req_id = 80eaee83-18d7-44a0-84fe-5013e117e7bf resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
11942025-01-30T20:18:09.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62991 req_id = 80eaee83-18d7-44a0-84fe-5013e117e7bf response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
11952025-01-30T20:18:09.495ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11962025-01-30T20:18:09.495ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11972025-01-30T20:18:09.498ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11982025-01-30T20:18:09.498ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11992025-01-30T20:18:09.500ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12002025-01-30T20:18:09.502ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
12012025-01-30T20:18:09.502ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12022025-01-30T20:18:10.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62991 req_id = 2f212bc7-9e39-4e15-a266-dff130276d83 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
12032025-01-30T20:18:10.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62991 req_id = 2f212bc7-9e39-4e15-a266-dff130276d83 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
12042025-01-30T20:18:10.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62991 req_id = 2f212bc7-9e39-4e15-a266-dff130276d83 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
12052025-01-30T20:18:10.641ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:58 sled_uuid = 80be2cf5-c1f1-42e5-8353-289dd0bb621a
12062025-01-30T20:18:10.768ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
12072025-01-30T20:18:10.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134057 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62991 req_id = c71335b8-ab2a-4c4b-a21b-45625cbcbd11 response_code = 204 uri = /sled-agents/80be2cf5-c1f1-42e5-8353-289dd0bb621a
12082025-01-30T20:18:10.768ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12092025-01-30T20:18:10.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12102025-01-30T20:18:10.770ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12112025-01-30T20:18:10.772ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
12122025-01-30T20:18:10.772ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12132025-01-30T20:18:10.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12142025-01-30T20:18:10.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
12152025-01-30T20:18:10.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12162025-01-30T20:18:10.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
12172025-01-30T20:18:10.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12182025-01-30T20:18:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12192025-01-30T20:18:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12202025-01-30T20:18:10.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12212025-01-30T20:18:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12222025-01-30T20:18:10.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12232025-01-30T20:18:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12242025-01-30T20:18:10.810ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
12252025-01-30T20:18:10.810ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 9.219055ms iteration = 5 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
12262025-01-30T20:18:10.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12272025-01-30T20:18:10.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12282025-01-30T20:18:10.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.254601ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12292025-01-30T20:18:10.889ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(aa5f23fc-ea0f-42ec-bc7f-eadc53effff9, 0), (56610056-3863-4730-be0d-b4e4e691da8d, 0), (4f39c396-f759-4b5d-99bc-8df6540f7454, 0)]
12302025-01-30T20:18:10.890ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2242, tv_nsec: 100281711 } })
12312025-01-30T20:18:10.921ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
12322025-01-30T20:18:10.921ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
12332025-01-30T20:18:10.921ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
12342025-01-30T20:18:10.921ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c9e4dfe-fba9-417e-b200-940e98055799", "content-length": "476", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12352025-01-30T20:18:10.921ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
12362025-01-30T20:18:10.921ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "564d957e-0800-43ae-847e-2ccb4d597e77", "content-length": "734", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12372025-01-30T20:18:10.921ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
12382025-01-30T20:18:10.922ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "39ed5012-bf1f-4746-b586-ee9ada7f4c72", "content-length": "111", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12392025-01-30T20:18:10.922ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
12402025-01-30T20:18:10.922ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a1515fe-c8c7-451b-b687-7178e6d80d69", "content-length": "111", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12412025-01-30T20:18:10.922ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
12422025-01-30T20:18:10.922ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f1359a2-5839-4568-9eb1-46e5f70ce2c9", "content-length": "167", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12432025-01-30T20:18:10.922ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
12442025-01-30T20:18:10.923ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8f70889-e56b-4332-a98f-36d0dda984e1", "content-length": "167", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12452025-01-30T20:18:10.923ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
12462025-01-30T20:18:10.923ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e13c4f6-fbf3-4fd4-8143-3857feecd339", "content-length": "175", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12472025-01-30T20:18:10.923ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
12482025-01-30T20:18:10.923ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c5941d3-b05c-4dc0-88da-d83b82523f96", "content-length": "175", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12492025-01-30T20:18:10.923ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
12502025-01-30T20:18:10.923ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7b21163-36fb-48be-8966-95690d8f910a", "content-length": "702", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12512025-01-30T20:18:10.923ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
12522025-01-30T20:18:10.923ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c3b97ec-a9c7-4fd1-8c84-276e87f1b5ad", "content-length": "727", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12532025-01-30T20:18:10.923ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
12542025-01-30T20:18:10.924ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "49178a14-619e-4285-8c9b-d910f64bb13a", "content-length": "729", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12552025-01-30T20:18:10.924ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
12562025-01-30T20:18:10.924ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6136fe6c-4c28-42b8-b8fd-f761442a8f9f", "content-length": "728", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12572025-01-30T20:18:10.924ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
12582025-01-30T20:18:10.924ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "01006a1a-b4d1-4cc3-9538-6cbff4928021", "content-length": "722", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12592025-01-30T20:18:10.924ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
12602025-01-30T20:18:10.924ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a341deef-1a01-4259-8169-e8e635bd928e", "content-length": "109", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12612025-01-30T20:18:10.924ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
12622025-01-30T20:18:10.925ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "96ff563e-d767-4e15-a157-b60711253edb", "content-length": "109", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12632025-01-30T20:18:10.925ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
12642025-01-30T20:18:10.925ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "abc929b1-ae8b-42e9-abb5-4cb2cfd6b7c6", "content-length": "169", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12652025-01-30T20:18:10.925ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
12662025-01-30T20:18:10.925ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fee1d96-5ecb-4027-8253-91333c00a0e5", "content-length": "169", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12672025-01-30T20:18:10.925ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
12682025-01-30T20:18:10.925ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb78a9b7-851b-4c63-b805-3872d866d0be", "content-length": "178", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12692025-01-30T20:18:10.925ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
12702025-01-30T20:18:10.926ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "35b86541-0d9b-45cf-b78a-33d68a5d89ac", "content-length": "178", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12712025-01-30T20:18:10.926ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
12722025-01-30T20:18:10.926ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0fa6b26-8e33-445e-bff3-e6ea1430ec97", "content-length": "702", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12732025-01-30T20:18:10.926ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
12742025-01-30T20:18:10.926ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7a51c6c-3f0a-4563-bf61-749b7d2c9ef8", "content-length": "727", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12752025-01-30T20:18:10.926ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
12762025-01-30T20:18:10.926ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3deaf9e1-8cdf-4b62-9ca4-f64ff25ebdbf", "content-length": "729", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12772025-01-30T20:18:10.926ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
12782025-01-30T20:18:10.926ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "27cb0645-af52-49d2-84fa-78a1bb498640", "content-length": "728", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12792025-01-30T20:18:10.926ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12802025-01-30T20:18:10.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12812025-01-30T20:18:10.928ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12822025-01-30T20:18:10.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
12832025-01-30T20:18:10.930ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12842025-01-30T20:18:10.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12852025-01-30T20:18:10.931ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12862025-01-30T20:18:10.933ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
12872025-01-30T20:18:10.933ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12882025-01-30T20:18:10.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12892025-01-30T20:18:10.967ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
12902025-01-30T20:18:10.967ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
12912025-01-30T20:18:11.174ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "9542a3b0-25ea-438e-b645-f59ba08312e0", "content-length": "30782", "date": "Thu, 30 Jan 2025 20:18:10 GMT"} })
12922025-01-30T20:18:11.178ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
12932025-01-30T20:18:11.178ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
12942025-01-30T20:18:11.178ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
12952025-01-30T20:18:11.180ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12962025-01-30T20:18:11.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12972025-01-30T20:18:11.182ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12982025-01-30T20:18:11.184ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
12992025-01-30T20:18:11.186ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13002025-01-30T20:18:11.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13012025-01-30T20:18:11.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62991 req_id = ba4b4487-eb58-4b7c-9ff1-14721bd32d56 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
13022025-01-30T20:18:11.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62991 req_id = ba4b4487-eb58-4b7c-9ff1-14721bd32d56 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
13032025-01-30T20:18:11.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62991 req_id = ba4b4487-eb58-4b7c-9ff1-14721bd32d56 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
13042025-01-30T20:18:11.349ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:58323
13052025-01-30T20:18:11.504ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13062025-01-30T20:18:11.504ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13072025-01-30T20:18:11.506ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13082025-01-30T20:18:11.506ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13092025-01-30T20:18:11.507ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13102025-01-30T20:18:11.510ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
13112025-01-30T20:18:11.510ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, time_created: 2025-01-30T20:17:31.012361Z, time_modified: 2025-01-30T20:17:31.012361Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
13122025-01-30T20:18:11.571ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = f0cace30-059d-4298-810c-da65e8288256 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
13132025-01-30T20:18:11.571ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = f0cace30-059d-4298-810c-da65e8288256 time_started = 2025-01-30 20:18:10.920993 UTC
13142025-01-30T20:18:11.571ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 802.40577ms iteration = 2 status = {"collection_id":"f0cace30-059d-4298-810c-da65e8288256","time_done":"2025-01-30 20:18:11.178684 UTC","time_started":"2025-01-30 20:18:10.920993 UTC"}
13152025-01-30T20:18:11.571ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Dependency
13162025-01-30T20:18:11.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 3 reason = Dependency
13172025-01-30T20:18:11.571ZWARNnexus (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous file = nexus/src/app/background/tasks/blueprint_rendezvous.rs:52 reason = no blueprint
13182025-01-30T20:18:11.571ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 5.461\u{b5}s iteration = 3 status = {"error":"no blueprint"}
13192025-01-30T20:18:11.571ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13202025-01-30T20:18:11.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13212025-01-30T20:18:11.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13222025-01-30T20:18:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13232025-01-30T20:18:11.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13242025-01-30T20:18:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13252025-01-30T20:18:11.576ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
13262025-01-30T20:18:11.576ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.222445ms iteration = 4 status = {"error":"rack not yet initialized: 6cd2152b-e0e7-4208-8446-3b1ba878a49f"}
13272025-01-30T20:18:12.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ddb22990-c2f7-47bb-8717-0e1b282d5b1c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
13282025-01-30T20:18:12.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ddb22990-c2f7-47bb-8717-0e1b282d5b1c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
13292025-01-30T20:18:12.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ddb22990-c2f7-47bb-8717-0e1b282d5b1c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
13302025-01-30T20:18:13.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 79fae200-1daf-446e-b2c2-dbc71b382349 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
13312025-01-30T20:18:13.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 79fae200-1daf-446e-b2c2-dbc71b382349 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
13322025-01-30T20:18:13.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 79fae200-1daf-446e-b2c2-dbc71b382349 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
13332025-01-30T20:18:13.512ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13342025-01-30T20:18:13.512ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13352025-01-30T20:18:13.514ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13362025-01-30T20:18:13.514ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13372025-01-30T20:18:13.516ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13382025-01-30T20:18:13.518ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, lookup_type: ById(6cd2152b-e0e7-4208-8446-3b1ba878a49f) } result = Ok(())
13392025-01-30T20:18:13.518ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
13402025-01-30T20:18:13.518ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13412025-01-30T20:18:13.518ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13422025-01-30T20:18:13.520ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13432025-01-30T20:18:13.520ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13442025-01-30T20:18:13.522ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13452025-01-30T20:18:13.522ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13462025-01-30T20:18:13.523ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13472025-01-30T20:18:13.523ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13482025-01-30T20:18:13.525ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13492025-01-30T20:18:13.525ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13502025-01-30T20:18:13.526ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13512025-01-30T20:18:13.526ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13522025-01-30T20:18:13.527ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13532025-01-30T20:18:13.530ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13542025-01-30T20:18:13.530ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13552025-01-30T20:18:13.530ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13562025-01-30T20:18:13.532ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13572025-01-30T20:18:13.532ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13582025-01-30T20:18:13.533ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13592025-01-30T20:18:13.533ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13602025-01-30T20:18:13.534ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13612025-01-30T20:18:13.537ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13622025-01-30T20:18:13.537ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13632025-01-30T20:18:13.538ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13642025-01-30T20:18:13.561ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13652025-01-30T20:18:13.561ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13662025-01-30T20:18:13.563ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13672025-01-30T20:18:13.563ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13682025-01-30T20:18:13.564ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13692025-01-30T20:18:13.564ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13702025-01-30T20:18:13.566ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13712025-01-30T20:18:13.566ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13722025-01-30T20:18:13.567ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13732025-01-30T20:18:13.567ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13742025-01-30T20:18:13.569ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13752025-01-30T20:18:13.569ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13762025-01-30T20:18:13.570ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13772025-01-30T20:18:13.574ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13782025-01-30T20:18:13.574ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13792025-01-30T20:18:13.574ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13802025-01-30T20:18:13.575ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13812025-01-30T20:18:13.575ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13822025-01-30T20:18:13.577ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13832025-01-30T20:18:13.577ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13842025-01-30T20:18:13.579ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13852025-01-30T20:18:13.579ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13862025-01-30T20:18:13.581ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13872025-01-30T20:18:13.581ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13882025-01-30T20:18:13.582ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13892025-01-30T20:18:13.583ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13902025-01-30T20:18:13.584ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13912025-01-30T20:18:13.584ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13922025-01-30T20:18:13.585ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13932025-01-30T20:18:13.591ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
13942025-01-30T20:18:13.591ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13952025-01-30T20:18:13.591ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13962025-01-30T20:18:13.592ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13972025-01-30T20:18:13.592ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13982025-01-30T20:18:13.593ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13992025-01-30T20:18:13.594ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14002025-01-30T20:18:13.595ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14012025-01-30T20:18:13.598ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
14022025-01-30T20:18:13.598ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14032025-01-30T20:18:13.598ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14042025-01-30T20:18:13.608ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14052025-01-30T20:18:13.608ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14062025-01-30T20:18:13.610ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14072025-01-30T20:18:13.610ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14082025-01-30T20:18:13.611ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14092025-01-30T20:18:13.611ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14102025-01-30T20:18:13.614ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14112025-01-30T20:18:13.614ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14122025-01-30T20:18:13.616ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14132025-01-30T20:18:13.616ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14142025-01-30T20:18:13.617ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14152025-01-30T20:18:13.617ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14162025-01-30T20:18:13.619ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14172025-01-30T20:18:13.619ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14182025-01-30T20:18:13.620ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14192025-01-30T20:18:13.623ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
14202025-01-30T20:18:13.623ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14212025-01-30T20:18:13.623ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14222025-01-30T20:18:13.625ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14232025-01-30T20:18:13.625ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14242025-01-30T20:18:13.626ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14252025-01-30T20:18:13.626ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14262025-01-30T20:18:13.627ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14272025-01-30T20:18:13.631ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
14282025-01-30T20:18:13.631ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14292025-01-30T20:18:13.631ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14302025-01-30T20:18:13.642ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
14312025-01-30T20:18:13.642ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14322025-01-30T20:18:13.642ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14332025-01-30T20:18:13.643ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14342025-01-30T20:18:13.644ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
14352025-01-30T20:18:13.645ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14362025-01-30T20:18:13.645ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14372025-01-30T20:18:13.646ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
14382025-01-30T20:18:13.648ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
14392025-01-30T20:18:13.648ZDEBGnexus (InternalApi): resolved 2 rules for sleds
14402025-01-30T20:18:13.707ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, time_created: 2025-01-30T20:18:10.641871Z, time_modified: 2025-01-30T20:18:10.641871Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
14412025-01-30T20:18:13.707ZDEBGnexus (InternalApi): sending firewall rules to sled agents
14422025-01-30T20:18:13.707ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14432025-01-30T20:18:13.707ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14442025-01-30T20:18:13.710ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14452025-01-30T20:18:13.710ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14462025-01-30T20:18:13.711ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14472025-01-30T20:18:13.714ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
14482025-01-30T20:18:13.744ZDEBGnexus (InternalApi): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14492025-01-30T20:18:13.745ZDEBGnexus (InternalApi): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "f3e8b747-78c2-44e6-9722-92ce9433fe86", "date": "Thu, 30 Jan 2025 20:18:13 GMT"} })
14502025-01-30T20:18:13.745ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
14512025-01-30T20:18:13.745ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
14522025-01-30T20:18:14.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9292efb1-594b-47cf-b3e4-9e8aac129daf roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14532025-01-30T20:18:14.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9292efb1-594b-47cf-b3e4-9e8aac129daf resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14542025-01-30T20:18:14.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9292efb1-594b-47cf-b3e4-9e8aac129daf response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14552025-01-30T20:18:15.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 48206f6c-a2c4-4aab-b45b-2f5814878af3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14562025-01-30T20:18:15.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 48206f6c-a2c4-4aab-b45b-2f5814878af3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14572025-01-30T20:18:15.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 48206f6c-a2c4-4aab-b45b-2f5814878af3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14582025-01-30T20:18:16.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 25f173ec-36db-4e1b-a132-0b0a4dd838d3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14592025-01-30T20:18:16.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 25f173ec-36db-4e1b-a132-0b0a4dd838d3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14602025-01-30T20:18:16.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 25f173ec-36db-4e1b-a132-0b0a4dd838d3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14612025-01-30T20:18:17.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b71423ed-c4bb-4c2a-8b6e-8128b767a22a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14622025-01-30T20:18:17.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b71423ed-c4bb-4c2a-8b6e-8128b767a22a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14632025-01-30T20:18:17.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b71423ed-c4bb-4c2a-8b6e-8128b767a22a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14642025-01-30T20:18:18.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fa4fb3d5-5d07-4a01-8111-cca4aee1d979 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14652025-01-30T20:18:18.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fa4fb3d5-5d07-4a01-8111-cca4aee1d979 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14662025-01-30T20:18:18.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fa4fb3d5-5d07-4a01-8111-cca4aee1d979 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14672025-01-30T20:18:19.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4efdcf43-d3fa-417d-af28-b9a8ccb58098 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14682025-01-30T20:18:19.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4efdcf43-d3fa-417d-af28-b9a8ccb58098 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14692025-01-30T20:18:19.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4efdcf43-d3fa-417d-af28-b9a8ccb58098 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14702025-01-30T20:18:20.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8166f02f-6936-4e09-b2dd-c8865af009e2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14712025-01-30T20:18:20.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8166f02f-6936-4e09-b2dd-c8865af009e2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14722025-01-30T20:18:20.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8166f02f-6936-4e09-b2dd-c8865af009e2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
14732025-01-30T20:18:20.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
14742025-01-30T20:18:20.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14752025-01-30T20:18:20.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
14762025-01-30T20:18:20.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14772025-01-30T20:18:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14782025-01-30T20:18:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14792025-01-30T20:18:20.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14802025-01-30T20:18:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14812025-01-30T20:18:20.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14822025-01-30T20:18:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14832025-01-30T20:18:20.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14842025-01-30T20:18:20.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14852025-01-30T20:18:20.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14862025-01-30T20:18:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
14872025-01-30T20:18:20.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14882025-01-30T20:18:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14892025-01-30T20:18:20.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14902025-01-30T20:18:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14912025-01-30T20:18:20.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.028767ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14922025-01-30T20:18:20.945ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
14932025-01-30T20:18:20.945ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 144.466439ms iteration = 6 status = {"enabled":false,"status":"first target blueprint","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z","time_found":"2025-01-30T20:18:20.945316215Z"}
14942025-01-30T20:18:20.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
14952025-01-30T20:18:20.945ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
14962025-01-30T20:18:20.945ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 6.38\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
14972025-01-30T20:18:20.945ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
14982025-01-30T20:18:20.945ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14992025-01-30T20:18:20.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15002025-01-30T20:18:20.945ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15012025-01-30T20:18:20.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15022025-01-30T20:18:20.945ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15032025-01-30T20:18:20.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15042025-01-30T20:18:20.945ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15052025-01-30T20:18:20.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15062025-01-30T20:18:20.946ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15072025-01-30T20:18:20.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15082025-01-30T20:18:20.947ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15092025-01-30T20:18:20.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15102025-01-30T20:18:20.949ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15112025-01-30T20:18:20.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15122025-01-30T20:18:20.949ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15132025-01-30T20:18:20.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15142025-01-30T20:18:20.951ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15152025-01-30T20:18:20.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15162025-01-30T20:18:20.951ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15172025-01-30T20:18:20.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15182025-01-30T20:18:20.952ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15192025-01-30T20:18:20.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15202025-01-30T20:18:20.953ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15212025-01-30T20:18:20.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15222025-01-30T20:18:20.955ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15232025-01-30T20:18:20.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15242025-01-30T20:18:20.955ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15252025-01-30T20:18:20.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15262025-01-30T20:18:20.956ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15272025-01-30T20:18:20.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15282025-01-30T20:18:20.987ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
15292025-01-30T20:18:21.019ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
15302025-01-30T20:18:21.054ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
15312025-01-30T20:18:21.089ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
15322025-01-30T20:18:21.121ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
15332025-01-30T20:18:21.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9988ad2a-f9c8-4106-8684-7449e0129026 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15342025-01-30T20:18:21.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9988ad2a-f9c8-4106-8684-7449e0129026 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15352025-01-30T20:18:21.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9988ad2a-f9c8-4106-8684-7449e0129026 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15362025-01-30T20:18:22.037ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d61d9522-bb23-4110-a367-8785ea6c3ad6", "content-length": "64", "date": "Thu, 30 Jan 2025 20:18:21 GMT"} })
15372025-01-30T20:18:22.038ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15382025-01-30T20:18:22.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15392025-01-30T20:18:22.040ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15402025-01-30T20:18:22.041ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15412025-01-30T20:18:22.041ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15422025-01-30T20:18:22.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15432025-01-30T20:18:22.068ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c03e7d0-9bd4-4160-8c6c-ee4f11b42e26", "content-length": "64", "date": "Thu, 30 Jan 2025 20:18:21 GMT"} })
15442025-01-30T20:18:22.068ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15452025-01-30T20:18:22.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15462025-01-30T20:18:22.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15472025-01-30T20:18:22.070ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15482025-01-30T20:18:22.070ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15492025-01-30T20:18:22.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15502025-01-30T20:18:22.084ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d19b6310-fde2-4e75-b230-92bfb14548e9", "content-length": "64", "date": "Thu, 30 Jan 2025 20:18:21 GMT"} })
15512025-01-30T20:18:22.084ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15522025-01-30T20:18:22.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15532025-01-30T20:18:22.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15542025-01-30T20:18:22.087ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15552025-01-30T20:18:22.087ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15562025-01-30T20:18:22.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15572025-01-30T20:18:22.192ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6869ef6-a10b-480a-be87-079e0fb24e7a", "content-length": "64", "date": "Thu, 30 Jan 2025 20:18:21 GMT"} })
15582025-01-30T20:18:22.192ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15592025-01-30T20:18:22.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15602025-01-30T20:18:22.194ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15612025-01-30T20:18:22.195ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15622025-01-30T20:18:22.195ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15632025-01-30T20:18:22.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15642025-01-30T20:18:22.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 530b19c3-7c2c-4bc5-b556-50598895399a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15652025-01-30T20:18:22.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 530b19c3-7c2c-4bc5-b556-50598895399a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15662025-01-30T20:18:22.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 530b19c3-7c2c-4bc5-b556-50598895399a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15672025-01-30T20:18:23.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9a87fa86-e5d4-46d1-8754-2241a42989f8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15682025-01-30T20:18:23.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9a87fa86-e5d4-46d1-8754-2241a42989f8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15692025-01-30T20:18:23.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9a87fa86-e5d4-46d1-8754-2241a42989f8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15702025-01-30T20:18:24.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a224272c-8967-46b5-8a50-9183fd7cf785 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15712025-01-30T20:18:24.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a224272c-8967-46b5-8a50-9183fd7cf785 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15722025-01-30T20:18:24.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a224272c-8967-46b5-8a50-9183fd7cf785 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15732025-01-30T20:18:25.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 87405875-bcc5-4b51-84ab-3a131880fc89 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15742025-01-30T20:18:25.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 87405875-bcc5-4b51-84ab-3a131880fc89 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15752025-01-30T20:18:25.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 87405875-bcc5-4b51-84ab-3a131880fc89 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15762025-01-30T20:18:26.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6de1631b-ae8e-4275-8233-dae803e6760f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15772025-01-30T20:18:26.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6de1631b-ae8e-4275-8233-dae803e6760f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15782025-01-30T20:18:26.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6de1631b-ae8e-4275-8233-dae803e6760f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15792025-01-30T20:18:27.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 79287b0a-c015-4342-8401-03b717bafaeb roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15802025-01-30T20:18:27.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 79287b0a-c015-4342-8401-03b717bafaeb resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15812025-01-30T20:18:27.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 79287b0a-c015-4342-8401-03b717bafaeb response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15822025-01-30T20:18:28.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7b92d0e3-6256-4f50-9afd-7f82dcb0bb8b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15832025-01-30T20:18:28.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7b92d0e3-6256-4f50-9afd-7f82dcb0bb8b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15842025-01-30T20:18:28.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7b92d0e3-6256-4f50-9afd-7f82dcb0bb8b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15852025-01-30T20:18:29.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ff4d468-4278-43fe-b3b0-f4c75dcaac4e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15862025-01-30T20:18:29.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ff4d468-4278-43fe-b3b0-f4c75dcaac4e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15872025-01-30T20:18:29.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ff4d468-4278-43fe-b3b0-f4c75dcaac4e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15882025-01-30T20:18:30.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1d304185-f234-4152-baad-1acaf749306f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15892025-01-30T20:18:30.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1d304185-f234-4152-baad-1acaf749306f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15902025-01-30T20:18:30.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1d304185-f234-4152-baad-1acaf749306f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
15912025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
15922025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
15932025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
15942025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15952025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
15962025-01-30T20:18:30.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:08:30.801107882 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
15972025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
15982025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
15992025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
16002025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16012025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
16022025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16032025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
16042025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16052025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
16062025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
16072025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16082025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
16092025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
16102025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
16112025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
16122025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16132025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16142025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
16152025-01-30T20:18:30.801ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
16162025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
16172025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
16182025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
16192025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16202025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16212025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
16222025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16232025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
16242025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
16252025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
16262025-01-30T20:18:30.801ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16272025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16282025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 12.271\u{b5}s iteration = 3 status = {"error":"no config"}
16292025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
16302025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
16312025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
16322025-01-30T20:18:30.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
16332025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 7.16\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
16342025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
16352025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 3 reason = Timeout
16362025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
16372025-01-30T20:18:30.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16382025-01-30T20:18:30.801ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16392025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 11.74\u{b5}s iteration = 3 status = {"error":"no config"}
16402025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16412025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16422025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
16432025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
16442025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16452025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
16462025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
16472025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16482025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
16492025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16502025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16512025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16522025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
16532025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16542025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
16552025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16562025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16572025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
16582025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16592025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16602025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
16612025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16622025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16632025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
16642025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16652025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16662025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16672025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
16682025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16692025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16702025-01-30T20:18:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
16712025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16722025-01-30T20:18:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2262, tv_nsec: 12166865 } })
16732025-01-30T20:18:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2262, tv_nsec: 12170935 } })
16742025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16752025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16762025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16772025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16782025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16792025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16802025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16812025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16822025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16832025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16842025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16852025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16862025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
16872025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.43323ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
16882025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
16892025-01-30T20:18:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.345167ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
16902025-01-30T20:18:30.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16912025-01-30T20:18:30.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2262, tv_nsec: 15439146 } })
16922025-01-30T20:18:30.805ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:08:30.801107882 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
16932025-01-30T20:18:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.214567ms iteration = 2 status = {"expiration":"2025-01-30T20:08:30.801107882Z","pruned":[]}
16942025-01-30T20:18:30.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16952025-01-30T20:18:30.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
16962025-01-30T20:18:30.805ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16972025-01-30T20:18:30.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.316597ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16982025-01-30T20:18:30.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16992025-01-30T20:18:30.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.833262ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
17002025-01-30T20:18:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
17012025-01-30T20:18:30.808ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17022025-01-30T20:18:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17032025-01-30T20:18:30.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17042025-01-30T20:18:30.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17052025-01-30T20:18:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17062025-01-30T20:18:30.809ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.886119ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
17072025-01-30T20:18:30.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17082025-01-30T20:18:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17092025-01-30T20:18:30.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17102025-01-30T20:18:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17112025-01-30T20:18:30.813ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17122025-01-30T20:18:30.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17132025-01-30T20:18:30.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17142025-01-30T20:18:30.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17152025-01-30T20:18:30.815ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17162025-01-30T20:18:30.816ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2262, tv_nsec: 26260676 } })
17172025-01-30T20:18:30.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
17182025-01-30T20:18:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17192025-01-30T20:18:30.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17202025-01-30T20:18:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17212025-01-30T20:18:30.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17222025-01-30T20:18:30.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17232025-01-30T20:18:30.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17242025-01-30T20:18:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17252025-01-30T20:18:30.818ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17262025-01-30T20:18:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17272025-01-30T20:18:30.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17282025-01-30T20:18:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17292025-01-30T20:18:30.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17302025-01-30T20:18:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17312025-01-30T20:18:30.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17322025-01-30T20:18:30.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17332025-01-30T20:18:30.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17342025-01-30T20:18:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17352025-01-30T20:18:30.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17362025-01-30T20:18:30.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17372025-01-30T20:18:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17382025-01-30T20:18:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17392025-01-30T20:18:30.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17402025-01-30T20:18:30.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.831707ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17412025-01-30T20:18:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17422025-01-30T20:18:30.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17432025-01-30T20:18:30.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17442025-01-30T20:18:30.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17452025-01-30T20:18:30.829ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17462025-01-30T20:18:30.829ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2262, tv_nsec: 39203675 } })
17472025-01-30T20:18:30.829ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
17482025-01-30T20:18:30.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17492025-01-30T20:18:30.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
17502025-01-30T20:18:30.833ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17512025-01-30T20:18:30.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17522025-01-30T20:18:30.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.941999ms iteration = 3 status = {"errors":[],"finish_invoked_ok":[]}
17532025-01-30T20:18:30.859ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
17542025-01-30T20:18:30.859ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
17552025-01-30T20:18:30.859ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.217746ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
17562025-01-30T20:18:30.860ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17572025-01-30T20:18:30.860ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17582025-01-30T20:18:30.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17592025-01-30T20:18:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17602025-01-30T20:18:30.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17612025-01-30T20:18:30.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17622025-01-30T20:18:30.868ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17632025-01-30T20:18:30.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17642025-01-30T20:18:30.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17652025-01-30T20:18:30.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17662025-01-30T20:18:30.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17672025-01-30T20:18:30.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17682025-01-30T20:18:30.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17692025-01-30T20:18:30.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17702025-01-30T20:18:30.870ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
17712025-01-30T20:18:30.870ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
17722025-01-30T20:18:30.870ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 69.586851ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
17732025-01-30T20:18:30.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17742025-01-30T20:18:30.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.96611ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17752025-01-30T20:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17762025-01-30T20:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17772025-01-30T20:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17782025-01-30T20:18:30.878ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17792025-01-30T20:18:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17802025-01-30T20:18:30.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17812025-01-30T20:18:30.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17822025-01-30T20:18:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17832025-01-30T20:18:30.882ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17842025-01-30T20:18:30.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17852025-01-30T20:18:30.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17862025-01-30T20:18:30.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17872025-01-30T20:18:30.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17882025-01-30T20:18:30.882ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17892025-01-30T20:18:30.883ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.547144ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17902025-01-30T20:18:30.883ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
17912025-01-30T20:18:30.883ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
17922025-01-30T20:18:30.883ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
17932025-01-30T20:18:30.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17942025-01-30T20:18:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17952025-01-30T20:18:30.883ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
17962025-01-30T20:18:30.883ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
17972025-01-30T20:18:30.883ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
17982025-01-30T20:18:30.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17992025-01-30T20:18:30.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18002025-01-30T20:18:30.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18012025-01-30T20:18:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
18022025-01-30T20:18:30.886ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18032025-01-30T20:18:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
18042025-01-30T20:18:30.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18052025-01-30T20:18:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18062025-01-30T20:18:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18072025-01-30T20:18:30.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18082025-01-30T20:18:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18092025-01-30T20:18:30.887ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18102025-01-30T20:18:30.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18112025-01-30T20:18:30.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18122025-01-30T20:18:30.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18132025-01-30T20:18:30.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18142025-01-30T20:18:30.888ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
18152025-01-30T20:18:30.888ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 87.312383ms iteration = 3 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
18162025-01-30T20:18:30.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18172025-01-30T20:18:30.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18182025-01-30T20:18:30.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18192025-01-30T20:18:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18202025-01-30T20:18:30.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18212025-01-30T20:18:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18222025-01-30T20:18:30.893ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18232025-01-30T20:18:30.894ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
18242025-01-30T20:18:30.894ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
18252025-01-30T20:18:30.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18262025-01-30T20:18:30.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18272025-01-30T20:18:30.895ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18282025-01-30T20:18:30.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18292025-01-30T20:18:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18302025-01-30T20:18:30.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18312025-01-30T20:18:30.898ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
18322025-01-30T20:18:30.898ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18332025-01-30T20:18:30.898ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7733738-df7c-4528-bb00-c7de6d150a12", "content-length": "26", "date": "Thu, 30 Jan 2025 20:18:30 GMT"} })
18342025-01-30T20:18:30.898ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18352025-01-30T20:18:30.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18362025-01-30T20:18:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18372025-01-30T20:18:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18382025-01-30T20:18:30.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18392025-01-30T20:18:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18402025-01-30T20:18:30.899ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18412025-01-30T20:18:30.901ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
18422025-01-30T20:18:30.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.700847ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
18432025-01-30T20:18:30.903ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
18442025-01-30T20:18:30.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.453739ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18452025-01-30T20:18:30.905ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
18462025-01-30T20:18:30.905ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
18472025-01-30T20:18:30.905ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 104.525191ms iteration = 2 status = {"generation":2}
18482025-01-30T20:18:30.905ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
18492025-01-30T20:18:30.906ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18502025-01-30T20:18:30.906ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18512025-01-30T20:18:30.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18522025-01-30T20:18:30.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18532025-01-30T20:18:30.911ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18542025-01-30T20:18:30.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18552025-01-30T20:18:30.925ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
18562025-01-30T20:18:30.925ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
18572025-01-30T20:18:30.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18582025-01-30T20:18:30.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18592025-01-30T20:18:30.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18602025-01-30T20:18:30.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18612025-01-30T20:18:30.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18622025-01-30T20:18:30.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18632025-01-30T20:18:30.939ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18642025-01-30T20:18:30.939ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18652025-01-30T20:18:30.939ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 137.988229ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
18662025-01-30T20:18:30.943ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
18672025-01-30T20:18:30.943ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
18682025-01-30T20:18:30.943ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
18692025-01-30T20:18:30.943ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 142.583467ms iteration = 2 status = {"generation":1}
18702025-01-30T20:18:30.943ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
18712025-01-30T20:18:30.954ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
18722025-01-30T20:18:30.954ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 153.211442ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
18732025-01-30T20:18:30.966ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
18742025-01-30T20:18:30.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 165.341809ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
18752025-01-30T20:18:30.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18762025-01-30T20:18:30.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18772025-01-30T20:18:30.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18782025-01-30T20:18:30.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18792025-01-30T20:18:30.970ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18802025-01-30T20:18:30.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18812025-01-30T20:18:30.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18822025-01-30T20:18:30.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18832025-01-30T20:18:30.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18842025-01-30T20:18:30.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18852025-01-30T20:18:30.981ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18862025-01-30T20:18:30.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18872025-01-30T20:18:30.983ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18882025-01-30T20:18:30.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18892025-01-30T20:18:30.985ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18902025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
18912025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
18922025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
18932025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
18942025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
18952025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
18962025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
18972025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
18982025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
18992025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
19002025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
19012025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
19022025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles versions = all
19032025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/system/support-bundles versions = all
19042025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
19052025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
19062025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
19072025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
19082025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
19092025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
19102025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
19112025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
19122025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
19132025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
19142025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
19152025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
19162025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
19172025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
19182025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
19192025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
19202025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
19212025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
19222025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
19232025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/affinity-groups versions = all
19242025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/affinity-groups versions = all
19252025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
19262025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
19272025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
19282025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
19292025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
19302025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
19312025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
19322025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/anti-affinity-groups versions = all
19332025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/anti-affinity-groups versions = all
19342025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
19352025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
19362025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
19372025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
19382025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
19392025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
19402025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
19412025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
19422025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
19432025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
19442025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
19452025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
19462025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
19472025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
19482025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
19492025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
19502025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
19512025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
19522025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
19532025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
19542025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
19552025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
19562025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
19572025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
19582025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
19592025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
19602025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
19612025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
19622025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
19632025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
19642025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
19652025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
19662025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
19672025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
19682025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
19692025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
19702025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
19712025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
19722025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
19732025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
19742025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
19752025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
19762025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
19772025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
19782025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
19792025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
19802025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
19812025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
19822025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
19832025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
19842025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
19852025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
19862025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
19872025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
19882025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
19892025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
19902025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
19912025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
19922025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
19932025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
19942025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
19952025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
19962025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
19972025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
19982025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
19992025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
20002025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
20012025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
20022025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
20032025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
20042025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
20052025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
20062025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
20072025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
20082025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
20092025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
20102025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
20112025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
20122025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
20132025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
20142025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
20152025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
20162025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
20172025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
20182025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
20192025-01-30T20:18:30.986ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
20202025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
20212025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
20222025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
20232025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
20242025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
20252025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
20262025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
20272025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
20282025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
20292025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
20302025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
20312025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
20322025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
20332025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
20342025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
20352025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
20362025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
20372025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
20382025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
20392025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
20402025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
20412025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
20422025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
20432025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
20442025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
20452025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
20462025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
20472025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
20482025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
20492025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
20502025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
20512025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
20522025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
20532025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
20542025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
20552025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
20562025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
20572025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
20582025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
20592025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
20602025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
20612025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
20622025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
20632025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
20642025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
20652025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
20662025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
20672025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
20682025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
20692025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
20702025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
20712025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
20722025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
20732025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
20742025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
20752025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
20762025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
20772025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
20782025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
20792025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
20802025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
20812025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
20822025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
20832025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
20842025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
20852025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
20862025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
20872025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
20882025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
20892025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
20902025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
20912025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
20922025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
20932025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
20942025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
20952025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
20962025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
20972025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
20982025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
20992025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
21002025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
21012025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
21022025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
21032025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
21042025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
21052025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
21062025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
21072025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
21082025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
21092025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
21102025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
21112025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
21122025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
21132025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
21142025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
21152025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
21162025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
21172025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
21182025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
21192025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
21202025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
21212025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query versions = all
21222025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
21232025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
21242025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
21252025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
21262025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
21272025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
21282025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
21292025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
21302025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
21312025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
21322025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
21332025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
21342025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
21352025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
21362025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
21372025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
21382025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
21392025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
21402025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
21412025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
21422025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
21432025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
21442025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
21452025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
21462025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
21472025-01-30T20:18:30.987ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = 172.30.2.7:443
21482025-01-30T20:18:30.987ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
21492025-01-30T20:18:30.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
21502025-01-30T20:18:30.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21512025-01-30T20:18:30.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21522025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
21532025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
21542025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
21552025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
21562025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
21572025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
21582025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
21592025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
21602025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
21612025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
21622025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
21632025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
21642025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles versions = all
21652025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/system/support-bundles versions = all
21662025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
21672025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
21682025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
21692025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
21702025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
21712025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
21722025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
21732025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
21742025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
21752025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
21762025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
21772025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
21782025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
21792025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
21802025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
21812025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
21822025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
21832025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
21842025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
21852025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/affinity-groups versions = all
21862025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/affinity-groups versions = all
21872025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
21882025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
21892025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
21902025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
21912025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
21922025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
21932025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
21942025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/anti-affinity-groups versions = all
21952025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/anti-affinity-groups versions = all
21962025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
21972025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
21982025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
21992025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
22002025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
22012025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
22022025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
22032025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
22042025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
22052025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
22062025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
22072025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
22082025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
22092025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
22102025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
22112025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
22122025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
22132025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
22142025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
22152025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
22162025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
22172025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
22182025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
22192025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
22202025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
22212025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
22222025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
22232025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
22242025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
22252025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
22262025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
22272025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
22282025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
22292025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
22302025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
22312025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
22322025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
22332025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
22342025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
22352025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
22362025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
22372025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
22382025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
22392025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
22402025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
22412025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
22422025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
22432025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
22442025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
22452025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
22462025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
22472025-01-30T20:18:30.995ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
22482025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
22492025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
22502025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
22512025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
22522025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
22532025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
22542025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
22552025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
22562025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
22572025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
22582025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
22592025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
22602025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
22612025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
22622025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
22632025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
22642025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
22652025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
22662025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
22672025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
22682025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
22692025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
22702025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
22712025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
22722025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
22732025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
22742025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
22752025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
22762025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
22772025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
22782025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
22792025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
22802025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
22812025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
22822025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
22832025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
22842025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
22852025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
22862025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
22872025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
22882025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
22892025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
22902025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
22912025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
22922025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
22932025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
22942025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
22952025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
22962025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
22972025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
22982025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
22992025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
23002025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
23012025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
23022025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
23032025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
23042025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
23052025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
23062025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
23072025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
23082025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
23092025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
23102025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
23112025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
23122025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
23132025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
23142025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
23152025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
23162025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
23172025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
23182025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
23192025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
23202025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
23212025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
23222025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
23232025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
23242025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
23252025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
23262025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
23272025-01-30T20:18:30.996ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
23282025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
23292025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
23302025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
23312025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
23322025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
23332025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
23342025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
23352025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
23362025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
23372025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
23382025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
23392025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
23402025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
23412025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
23422025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
23432025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
23442025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
23452025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
23462025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
23472025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
23482025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
23492025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
23502025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
23512025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
23522025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
23532025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
23542025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
23552025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
23562025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
23572025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
23582025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
23592025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
23602025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
23612025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
23622025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
23632025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
23642025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
23652025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
23662025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
23672025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
23682025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
23692025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
23702025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
23712025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
23722025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
23732025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
23742025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
23752025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
23762025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
23772025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
23782025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
23792025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
23802025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
23812025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
23822025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
23832025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query versions = all
23842025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
23852025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
23862025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
23872025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
23882025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
23892025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
23902025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
23912025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
23922025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
23932025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
23942025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
23952025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
23962025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
23972025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
23982025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
23992025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
24002025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
24012025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
24022025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
24032025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
24042025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
24052025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
24062025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
24072025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
24082025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
24092025-01-30T20:18:30.999ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::c]:12228
24102025-01-30T20:18:30.999ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
24112025-01-30T20:18:30.999ZDEBGnexus (nexus-producer-server): registered DTrace probes
24122025-01-30T20:18:31.003ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:56425 method = GET path = /{producer_id} versions = all
24132025-01-30T20:18:31.003ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::c]:56425
24142025-01-30T20:18:31.003ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:56425
24152025-01-30T20:18:31.003ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:56425
24162025-01-30T20:18:31.003ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
24172025-01-30T20:18:31.003ZDEBGnexus (nexus-producer-server): starting producer registration task
24182025-01-30T20:18:31.004ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:56425 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
24192025-01-30T20:18:31.004ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
24202025-01-30T20:18:31.004ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
24212025-01-30T20:18:31.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 252.535639ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
24222025-01-30T20:18:31.067ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
24232025-01-30T20:18:31.067ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24242025-01-30T20:18:31.067ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1664257-fd84-46d0-a9ca-b1ca8bb05262", "content-length": "26", "date": "Thu, 30 Jan 2025 20:18:30 GMT"} })
24252025-01-30T20:18:31.067ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24262025-01-30T20:18:31.068ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24272025-01-30T20:18:31.071ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24282025-01-30T20:18:31.071ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24292025-01-30T20:18:31.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9118a49-6082-4e75-a166-c624d6a4719d", "content-length": "372", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} })
24302025-01-30T20:18:31.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24312025-01-30T20:18:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24322025-01-30T20:18:31.083ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 281.986937ms iteration = 5 status = {"physical_disks_added":0}
24332025-01-30T20:18:31.091ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
24342025-01-30T20:18:31.092ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24352025-01-30T20:18:31.092ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "39e8e542-cc9c-4014-a64c-8bc2e10fdeb4", "content-length": "26", "date": "Thu, 30 Jan 2025 20:18:30 GMT"} })
24362025-01-30T20:18:31.092ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24372025-01-30T20:18:31.093ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
24382025-01-30T20:18:31.093ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24392025-01-30T20:18:31.101ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24402025-01-30T20:18:31.101ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a694c76a-1ba8-4690-a3a6-be60b4e3b6fc", "content-length": "1", "date": "Thu, 30 Jan 2025 20:18:30 GMT"} })
24412025-01-30T20:18:31.103ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24422025-01-30T20:18:31.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24432025-01-30T20:18:31.224ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
24442025-01-30T20:18:31.225ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:49699
24452025-01-30T20:18:31.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49699 req_id = fef19a1a-9626-4ff5-bb33-93a4f095bab1 roles = RoleSet { roles: {} } uri = /metrics/producers
24462025-01-30T20:18:31.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49699 req_id = fef19a1a-9626-4ff5-bb33-93a4f095bab1 resource = Database result = Ok(()) uri = /metrics/producers
24472025-01-30T20:18:31.234ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
24482025-01-30T20:18:31.265ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 464.319147ms iteration = 3 status = {}
24492025-01-30T20:18:31.293ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24502025-01-30T20:18:31.293ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4cc7d1e5-6849-4332-96ea-e05fb3fc441a", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24512025-01-30T20:18:31.293ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24522025-01-30T20:18:31.295ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "59313482-49c8-4089-bf20-f53977498b42", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24532025-01-30T20:18:31.295ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24542025-01-30T20:18:31.297ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24552025-01-30T20:18:31.297ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 391.899727ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24562025-01-30T20:18:31.324ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24572025-01-30T20:18:31.325ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1597330-c6c9-4ca9-aae5-8e6e8aa61972", "content-length": "691", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} })
24582025-01-30T20:18:31.325ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24592025-01-30T20:18:31.325ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24602025-01-30T20:18:31.326ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24612025-01-30T20:18:31.327ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24622025-01-30T20:18:31.327ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 526.282886ms iteration = 3 status = {}
24632025-01-30T20:18:31.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24642025-01-30T20:18:31.330ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 529.033093ms iteration = 3 status = null
24652025-01-30T20:18:31.341ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24662025-01-30T20:18:31.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24672025-01-30T20:18:31.353ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24682025-01-30T20:18:31.360ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24692025-01-30T20:18:31.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24702025-01-30T20:18:31.372ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24712025-01-30T20:18:31.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24722025-01-30T20:18:31.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24732025-01-30T20:18:31.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24742025-01-30T20:18:31.386ZINFOnexus: assigned collector to new producer collector_id = 623434f7-1950-4ff8-a21d-872e401e4248 file = nexus/src/app/oximeter.rs:76 producer_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
24752025-01-30T20:18:31.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161163 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49699 req_id = fef19a1a-9626-4ff5-bb33-93a4f095bab1 response_code = 201 uri = /metrics/producers
24762025-01-30T20:18:31.386ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "fef19a1a-9626-4ff5-bb33-93a4f095bab1", "content-length": "41", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} })
24772025-01-30T20:18:31.388ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
24782025-01-30T20:18:31.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24792025-01-30T20:18:31.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24802025-01-30T20:18:31.391ZDEBGnexus (producer-registration-task): registered with nexus successfully
24812025-01-30T20:18:31.391ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
24822025-01-30T20:18:31.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24832025-01-30T20:18:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24842025-01-30T20:18:31.395ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
24852025-01-30T20:18:31.395ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24862025-01-30T20:18:31.396ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "30c8ead0-9ccd-4a67-a008-11c322f01115", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} })
24872025-01-30T20:18:31.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24882025-01-30T20:18:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24892025-01-30T20:18:31.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24902025-01-30T20:18:31.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24912025-01-30T20:18:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24922025-01-30T20:18:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24932025-01-30T20:18:31.403ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24942025-01-30T20:18:31.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24952025-01-30T20:18:31.404ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7673d308-ae1b-444a-b62f-72658dec83ca", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24962025-01-30T20:18:31.404ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24972025-01-30T20:18:31.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24982025-01-30T20:18:31.406ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "59f43f5b-dc40-4102-b6a0-6efd7603eb9b", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24992025-01-30T20:18:31.406ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
25002025-01-30T20:18:31.408ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25012025-01-30T20:18:31.408ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25022025-01-30T20:18:31.408ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d1025b0f-3616-4498-acf6-f5b769e058d4", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
25032025-01-30T20:18:31.408ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
25042025-01-30T20:18:31.408ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "343235ea-7057-42b8-9458-aebd5c75041f", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} })
25052025-01-30T20:18:31.409ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2262, tv_nsec: 619359127 } })
25062025-01-30T20:18:31.409ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1155
25072025-01-30T20:18:31.410ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 608.665383ms iteration = 3 status = {}
25082025-01-30T20:18:31.410ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
25092025-01-30T20:18:31.410ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 466.867068ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25102025-01-30T20:18:31.452ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
25112025-01-30T20:18:31.452ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25122025-01-30T20:18:31.452ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1fcc7b7-8927-4b76-93bc-20dc1ec51658", "content-length": "26", "date": "Thu, 30 Jan 2025 20:18:30 GMT"} })
25132025-01-30T20:18:31.452ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25142025-01-30T20:18:31.454ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25152025-01-30T20:18:31.504ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
25162025-01-30T20:18:31.505ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e1bee5a-4419-4a23-ae07-5bfae3adc41b", "content-length": "4", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} })
25172025-01-30T20:18:31.508ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 707.066154ms iteration = 3 status = 6
25182025-01-30T20:18:31.630ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25192025-01-30T20:18:31.632ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ffb45b2-4fe5-47f8-a4e7-c5ab6cf9a937", "content-length": "134", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} })
25202025-01-30T20:18:31.634ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25212025-01-30T20:18:31.635ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
25222025-01-30T20:18:31.637ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25232025-01-30T20:18:31.637ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25242025-01-30T20:18:31.637ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25252025-01-30T20:18:31.637ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25262025-01-30T20:18:31.637ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25272025-01-30T20:18:31.637ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25282025-01-30T20:18:31.649ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25292025-01-30T20:18:31.649ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25302025-01-30T20:18:31.649ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
25312025-01-30T20:18:31.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25322025-01-30T20:18:31.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25332025-01-30T20:18:31.661ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25342025-01-30T20:18:31.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 148c973c-37e2-4b8b-bf4d-eaa495c0f46d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25352025-01-30T20:18:31.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 148c973c-37e2-4b8b-bf4d-eaa495c0f46d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25362025-01-30T20:18:31.662ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b02ddc03-6fb2-4a10-9aec-16f0562fb4b8", "content-length": "2", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} })
25372025-01-30T20:18:31.662ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25382025-01-30T20:18:31.662ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b426895-5634-467d-8023-13f06c43c3ac", "content-length": "52", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} })
25392025-01-30T20:18:31.662ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
25402025-01-30T20:18:31.662ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25412025-01-30T20:18:31.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 148c973c-37e2-4b8b-bf4d-eaa495c0f46d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25422025-01-30T20:18:31.810ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6253ede3-ef1c-46d9-a36e-0e55d29b8a1c", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} })
25432025-01-30T20:18:31.810ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
25442025-01-30T20:18:31.810ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25452025-01-30T20:18:31.818ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "672c8ebb-85ef-4219-ab15-7aed24ccbe5f", "content-length": "539", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} })
25462025-01-30T20:18:31.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25472025-01-30T20:18:31.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25482025-01-30T20:18:31.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25492025-01-30T20:18:31.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25502025-01-30T20:18:31.833ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25512025-01-30T20:18:31.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25522025-01-30T20:18:31.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25532025-01-30T20:18:31.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25542025-01-30T20:18:31.843ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1229 key = network_key rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
25552025-01-30T20:18:31.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25562025-01-30T20:18:31.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25572025-01-30T20:18:31.855ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None }], switch: Switch0, tx_eq: None, uplink_port_fec: Some(None), uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 2, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1286 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
25582025-01-30T20:18:31.855ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25592025-01-30T20:18:31.866ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 204, headers: {"x-request-id": "29cbc1d8-88b8-4362-94da-3ed73ed52809", "date": "Thu, 30 Jan 2025 20:18:31 GMT"} })
25602025-01-30T20:18:31.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25612025-01-30T20:18:31.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25622025-01-30T20:18:31.881ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.080134308s iteration = 3 status = {}
25632025-01-30T20:18:32.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = fd609b17-024d-4aa7-8494-f1ec7386174c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
25642025-01-30T20:18:32.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = fd609b17-024d-4aa7-8494-f1ec7386174c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
25652025-01-30T20:18:32.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = fd609b17-024d-4aa7-8494-f1ec7386174c response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
25662025-01-30T20:18:32.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = ac4c21d0-f58e-46a0-b068-101dc15d5f86 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
25672025-01-30T20:18:32.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = ac4c21d0-f58e-46a0-b068-101dc15d5f86 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
25682025-01-30T20:18:32.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = ac4c21d0-f58e-46a0-b068-101dc15d5f86 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
25692025-01-30T20:18:32.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = cfa95335-c844-4a98-a462-d5c775ac1263 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
25702025-01-30T20:18:32.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = cfa95335-c844-4a98-a462-d5c775ac1263 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
25712025-01-30T20:18:32.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = cfa95335-c844-4a98-a462-d5c775ac1263 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
25722025-01-30T20:18:32.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = 883bc216-61da-41d4-9815-919f1f9077a3 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
25732025-01-30T20:18:32.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = 883bc216-61da-41d4-9815-919f1f9077a3 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
25742025-01-30T20:18:32.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = 883bc216-61da-41d4-9815-919f1f9077a3 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
25752025-01-30T20:18:32.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e33a75c7-4db1-45cd-876c-4f571452ebcf roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25762025-01-30T20:18:32.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e33a75c7-4db1-45cd-876c-4f571452ebcf resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25772025-01-30T20:18:32.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e33a75c7-4db1-45cd-876c-4f571452ebcf response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25782025-01-30T20:18:33.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd08f8f5-567b-4ad4-b7d3-aa0b8bb1ed49 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25792025-01-30T20:18:33.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd08f8f5-567b-4ad4-b7d3-aa0b8bb1ed49 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25802025-01-30T20:18:33.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd08f8f5-567b-4ad4-b7d3-aa0b8bb1ed49 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25812025-01-30T20:18:34.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 616fd755-fff1-47ca-8177-4c06ea21b21f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25822025-01-30T20:18:34.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 616fd755-fff1-47ca-8177-4c06ea21b21f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25832025-01-30T20:18:34.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 616fd755-fff1-47ca-8177-4c06ea21b21f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25842025-01-30T20:18:35.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f560469-10f4-4079-8eed-ed5b1a18fe56 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25852025-01-30T20:18:35.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f560469-10f4-4079-8eed-ed5b1a18fe56 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25862025-01-30T20:18:35.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f560469-10f4-4079-8eed-ed5b1a18fe56 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25872025-01-30T20:18:35.989ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::4]:32222/node/id", source: TimedOut })
25882025-01-30T20:18:35.993ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 15.047658492s iteration = 2 status = {"errors":[{"err":"failed to fetch node ID for zone 0abd2045-28a5-40c9-8b95-75ed8612d34a at http://[fd00:1122:3344:101::4]:32222: Communication Error: error sending request for url (http://[fd00:1122:3344:101::4]:32222/node/id): error sending request for url (http://[fd00:1122:3344:101::4]:32222/node/id): operation timed out","zone_id":"0abd2045-28a5-40c9-8b95-75ed8612d34a"}],"nsuccess":4}
25892025-01-30T20:18:36.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 22aa9f69-3bb2-4009-bfc7-33e405f41855 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25902025-01-30T20:18:36.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 22aa9f69-3bb2-4009-bfc7-33e405f41855 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25912025-01-30T20:18:36.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 22aa9f69-3bb2-4009-bfc7-33e405f41855 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25922025-01-30T20:18:37.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ef368b60-b37f-41d1-89f0-e82116ea5ef4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25932025-01-30T20:18:37.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ef368b60-b37f-41d1-89f0-e82116ea5ef4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25942025-01-30T20:18:37.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ef368b60-b37f-41d1-89f0-e82116ea5ef4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25952025-01-30T20:18:38.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dd4ab8f9-6df2-4b1c-8fd4-242ae15260c3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25962025-01-30T20:18:38.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dd4ab8f9-6df2-4b1c-8fd4-242ae15260c3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25972025-01-30T20:18:38.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dd4ab8f9-6df2-4b1c-8fd4-242ae15260c3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25982025-01-30T20:18:39.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f428bdd1-6fe2-4ba2-b45d-01335f2955a9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
25992025-01-30T20:18:39.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f428bdd1-6fe2-4ba2-b45d-01335f2955a9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26002025-01-30T20:18:39.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f428bdd1-6fe2-4ba2-b45d-01335f2955a9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26012025-01-30T20:18:40.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
26022025-01-30T20:18:40.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
26032025-01-30T20:18:40.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26042025-01-30T20:18:40.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26052025-01-30T20:18:40.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26062025-01-30T20:18:40.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26072025-01-30T20:18:40.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26082025-01-30T20:18:40.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26092025-01-30T20:18:40.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26102025-01-30T20:18:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26112025-01-30T20:18:40.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26122025-01-30T20:18:40.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.03837ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26132025-01-30T20:18:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26142025-01-30T20:18:40.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26152025-01-30T20:18:40.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26162025-01-30T20:18:40.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26172025-01-30T20:18:40.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
26182025-01-30T20:18:40.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26192025-01-30T20:18:40.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26202025-01-30T20:18:40.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
26212025-01-30T20:18:40.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.280464ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
26222025-01-30T20:18:41.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = caf79458-2f8c-410e-bc4a-b40f92efd4d9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26232025-01-30T20:18:41.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = caf79458-2f8c-410e-bc4a-b40f92efd4d9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26242025-01-30T20:18:41.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = caf79458-2f8c-410e-bc4a-b40f92efd4d9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26252025-01-30T20:18:42.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6dea5e40-b871-4403-b1de-afe1d8df20d9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26262025-01-30T20:18:42.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6dea5e40-b871-4403-b1de-afe1d8df20d9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26272025-01-30T20:18:42.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6dea5e40-b871-4403-b1de-afe1d8df20d9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26282025-01-30T20:18:42.446ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:56425 remote_addr = [fd00:1122:3344:101::d]:43683
26292025-01-30T20:18:42.455ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9054 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = d09956c9-237a-4bb5-ae5f-308acef9694e response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
26302025-01-30T20:18:43.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 885e6ce2-bd68-44a3-a2f4-35f3b33c85ef roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26312025-01-30T20:18:43.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 885e6ce2-bd68-44a3-a2f4-35f3b33c85ef resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26322025-01-30T20:18:43.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 885e6ce2-bd68-44a3-a2f4-35f3b33c85ef response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26332025-01-30T20:18:44.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 15f13a07-bd60-4ec5-9217-be8acacd6c80 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26342025-01-30T20:18:44.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 15f13a07-bd60-4ec5-9217-be8acacd6c80 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26352025-01-30T20:18:44.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 15f13a07-bd60-4ec5-9217-be8acacd6c80 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26362025-01-30T20:18:45.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 47fbbe53-68e1-4ae5-a123-b0782b56fb47 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26372025-01-30T20:18:45.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 47fbbe53-68e1-4ae5-a123-b0782b56fb47 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26382025-01-30T20:18:45.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 47fbbe53-68e1-4ae5-a123-b0782b56fb47 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26392025-01-30T20:18:46.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ca5f9757-7ceb-4be7-a393-f9d604381930 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26402025-01-30T20:18:46.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ca5f9757-7ceb-4be7-a393-f9d604381930 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26412025-01-30T20:18:46.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ca5f9757-7ceb-4be7-a393-f9d604381930 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26422025-01-30T20:18:47.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 18d20664-790c-4e1c-a11e-ca5b02734611 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26432025-01-30T20:18:47.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 18d20664-790c-4e1c-a11e-ca5b02734611 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26442025-01-30T20:18:47.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 18d20664-790c-4e1c-a11e-ca5b02734611 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26452025-01-30T20:18:48.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cad3864f-aa97-4dd3-b0e6-f6c1535d60af roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26462025-01-30T20:18:48.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cad3864f-aa97-4dd3-b0e6-f6c1535d60af resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26472025-01-30T20:18:48.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cad3864f-aa97-4dd3-b0e6-f6c1535d60af response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26482025-01-30T20:18:49.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 55ef1eed-7040-4fb6-be62-0cfe96f856a6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26492025-01-30T20:18:49.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 55ef1eed-7040-4fb6-be62-0cfe96f856a6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26502025-01-30T20:18:49.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 55ef1eed-7040-4fb6-be62-0cfe96f856a6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26512025-01-30T20:18:50.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5040e4bc-9d0e-4940-8e16-ce09cbeec92c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26522025-01-30T20:18:50.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5040e4bc-9d0e-4940-8e16-ce09cbeec92c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26532025-01-30T20:18:50.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5040e4bc-9d0e-4940-8e16-ce09cbeec92c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26542025-01-30T20:18:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
26552025-01-30T20:18:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
26562025-01-30T20:18:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26572025-01-30T20:18:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26582025-01-30T20:18:50.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26592025-01-30T20:18:50.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26602025-01-30T20:18:50.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26612025-01-30T20:18:50.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26622025-01-30T20:18:50.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26632025-01-30T20:18:50.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.073471ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26642025-01-30T20:18:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26652025-01-30T20:18:50.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26662025-01-30T20:18:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26672025-01-30T20:18:50.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26682025-01-30T20:18:50.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26692025-01-30T20:18:50.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26702025-01-30T20:18:50.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
26712025-01-30T20:18:50.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26722025-01-30T20:18:50.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26732025-01-30T20:18:50.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
26742025-01-30T20:18:50.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.67373ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
26752025-01-30T20:18:51.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ec39adef-41b8-41aa-b61a-6dd45fcd9bba roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26762025-01-30T20:18:51.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ec39adef-41b8-41aa-b61a-6dd45fcd9bba resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26772025-01-30T20:18:51.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ec39adef-41b8-41aa-b61a-6dd45fcd9bba response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26782025-01-30T20:18:52.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 062aa099-3fb4-4627-af73-affd6473e1fa roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26792025-01-30T20:18:52.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 062aa099-3fb4-4627-af73-affd6473e1fa resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26802025-01-30T20:18:52.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 062aa099-3fb4-4627-af73-affd6473e1fa response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26812025-01-30T20:18:52.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 614 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = d6ef0706-2721-4cb9-81e7-bd48b0bec570 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
26822025-01-30T20:18:53.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 52a2ad2f-e426-4d0f-bfb9-08774d5eb036 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26832025-01-30T20:18:53.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 52a2ad2f-e426-4d0f-bfb9-08774d5eb036 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26842025-01-30T20:18:53.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 52a2ad2f-e426-4d0f-bfb9-08774d5eb036 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26852025-01-30T20:18:54.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 261cd19a-87aa-432e-a8be-eeee163adfe5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26862025-01-30T20:18:54.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 261cd19a-87aa-432e-a8be-eeee163adfe5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26872025-01-30T20:18:54.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 261cd19a-87aa-432e-a8be-eeee163adfe5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26882025-01-30T20:18:55.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 707b4ad9-1ce3-4b43-b4a6-3329e9ce2838 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26892025-01-30T20:18:55.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 707b4ad9-1ce3-4b43-b4a6-3329e9ce2838 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26902025-01-30T20:18:55.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 707b4ad9-1ce3-4b43-b4a6-3329e9ce2838 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26912025-01-30T20:18:56.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 12ef03c2-4cf3-47bf-a29b-cab8bd50c02e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26922025-01-30T20:18:56.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 12ef03c2-4cf3-47bf-a29b-cab8bd50c02e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26932025-01-30T20:18:56.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 12ef03c2-4cf3-47bf-a29b-cab8bd50c02e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26942025-01-30T20:18:57.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fdc6bfcf-8b85-4efe-9b61-0644066dcf71 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26952025-01-30T20:18:57.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fdc6bfcf-8b85-4efe-9b61-0644066dcf71 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26962025-01-30T20:18:57.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fdc6bfcf-8b85-4efe-9b61-0644066dcf71 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26972025-01-30T20:18:58.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 32e821aa-b01d-4f11-bf43-911bdd2a614a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26982025-01-30T20:18:58.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 32e821aa-b01d-4f11-bf43-911bdd2a614a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
26992025-01-30T20:18:58.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 32e821aa-b01d-4f11-bf43-911bdd2a614a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
27002025-01-30T20:18:59.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c7ddb28f-91c6-4b88-a361-fed76c25c214 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
27012025-01-30T20:18:59.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c7ddb28f-91c6-4b88-a361-fed76c25c214 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
27022025-01-30T20:18:59.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c7ddb28f-91c6-4b88-a361-fed76c25c214 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
27032025-01-30T20:19:00.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 65ceb9ab-4b6c-49f2-a281-cc8c8c6c1c01 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
27042025-01-30T20:19:00.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 65ceb9ab-4b6c-49f2-a281-cc8c8c6c1c01 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
27052025-01-30T20:19:00.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 65ceb9ab-4b6c-49f2-a281-cc8c8c6c1c01 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
27062025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
27072025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27082025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
27092025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27102025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
27112025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
27122025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27132025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27142025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
27152025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
27162025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
27172025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27182025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27192025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27202025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
27212025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27222025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
27232025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27242025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
27252025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 4 reason = Timeout
27262025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
27272025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27282025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
27292025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27302025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
27312025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27322025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27332025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
27342025-01-30T20:19:00.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27352025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
27362025-01-30T20:19:00.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27372025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27382025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
27392025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
27402025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27412025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27422025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27432025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27442025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27452025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27462025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27472025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27482025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27492025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27502025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27512025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27522025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27532025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27542025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27552025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27562025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27572025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27582025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27592025-01-30T20:19:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27602025-01-30T20:19:00.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27612025-01-30T20:19:00.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27622025-01-30T20:19:00.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27632025-01-30T20:19:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27642025-01-30T20:19:00.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27652025-01-30T20:19:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27662025-01-30T20:19:00.807ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.657508ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27672025-01-30T20:19:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27682025-01-30T20:19:00.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27692025-01-30T20:19:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27702025-01-30T20:19:00.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2292, tv_nsec: 20231839 } })
27712025-01-30T20:19:00.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27722025-01-30T20:19:00.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
27732025-01-30T20:19:00.812ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27742025-01-30T20:19:00.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27752025-01-30T20:19:00.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.686372ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
27762025-01-30T20:19:00.818ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27772025-01-30T20:19:00.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27782025-01-30T20:19:00.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27792025-01-30T20:19:00.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27802025-01-30T20:19:00.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
27812025-01-30T20:19:00.820ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27822025-01-30T20:19:00.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27832025-01-30T20:19:00.821ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27842025-01-30T20:19:00.821ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27852025-01-30T20:19:00.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27862025-01-30T20:19:00.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27872025-01-30T20:19:00.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27882025-01-30T20:19:00.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27892025-01-30T20:19:00.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27902025-01-30T20:19:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27912025-01-30T20:19:00.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27922025-01-30T20:19:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27932025-01-30T20:19:00.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27942025-01-30T20:19:00.824ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27952025-01-30T20:19:00.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27962025-01-30T20:19:00.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27972025-01-30T20:19:00.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27982025-01-30T20:19:00.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27992025-01-30T20:19:00.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28002025-01-30T20:19:00.828ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2292, tv_nsec: 38668720 } })
28012025-01-30T20:19:00.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28022025-01-30T20:19:00.828ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
28032025-01-30T20:19:00.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28042025-01-30T20:19:00.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28052025-01-30T20:19:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28062025-01-30T20:19:00.830ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28072025-01-30T20:19:00.830ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28082025-01-30T20:19:00.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28092025-01-30T20:19:00.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28102025-01-30T20:19:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28112025-01-30T20:19:00.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28122025-01-30T20:19:00.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28132025-01-30T20:19:00.832ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28142025-01-30T20:19:00.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28152025-01-30T20:19:00.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28162025-01-30T20:19:00.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28172025-01-30T20:19:00.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28182025-01-30T20:19:00.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28192025-01-30T20:19:00.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28202025-01-30T20:19:00.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.598896ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
28212025-01-30T20:19:00.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28222025-01-30T20:19:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28232025-01-30T20:19:00.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28242025-01-30T20:19:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28252025-01-30T20:19:00.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28262025-01-30T20:19:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28272025-01-30T20:19:00.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28282025-01-30T20:19:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28292025-01-30T20:19:00.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28302025-01-30T20:19:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28312025-01-30T20:19:00.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28322025-01-30T20:19:00.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28332025-01-30T20:19:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28342025-01-30T20:19:00.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28352025-01-30T20:19:00.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.325003ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28362025-01-30T20:19:00.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
28372025-01-30T20:19:00.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28382025-01-30T20:19:00.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28392025-01-30T20:19:00.869ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28402025-01-30T20:19:00.869ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.002747ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28412025-01-30T20:19:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
28422025-01-30T20:19:00.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28432025-01-30T20:19:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28442025-01-30T20:19:00.871ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.801368ms iteration = 4 status = 0
28452025-01-30T20:19:00.872ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28462025-01-30T20:19:00.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28472025-01-30T20:19:00.874ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28482025-01-30T20:19:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
28492025-01-30T20:19:00.876ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28502025-01-30T20:19:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28512025-01-30T20:19:00.877ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
28522025-01-30T20:19:00.877ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 75.838945ms iteration = 4 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
28532025-01-30T20:19:00.879ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
28542025-01-30T20:19:00.879ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28552025-01-30T20:19:00.880ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ccfb776-7b83-41a4-bf7d-eafc9d2ca5bf", "content-length": "26", "date": "Thu, 30 Jan 2025 20:19:00 GMT"} })
28562025-01-30T20:19:00.880ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28572025-01-30T20:19:00.881ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28582025-01-30T20:19:00.882ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
28592025-01-30T20:19:00.882ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.797303ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
28602025-01-30T20:19:00.882ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28612025-01-30T20:19:00.882ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28622025-01-30T20:19:00.882ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 80.266788ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28632025-01-30T20:19:00.892ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
28642025-01-30T20:19:00.892ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28652025-01-30T20:19:00.892ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbf26e17-e93c-4919-a70e-e0059b4cb4b9", "content-length": "26", "date": "Thu, 30 Jan 2025 20:19:00 GMT"} })
28662025-01-30T20:19:00.892ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28672025-01-30T20:19:00.894ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
28682025-01-30T20:19:00.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 93.152795ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
28692025-01-30T20:19:00.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.594388ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28702025-01-30T20:19:00.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.539332ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28712025-01-30T20:19:00.929ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2292, tv_nsec: 139397386 } })
28722025-01-30T20:19:00.929ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
28732025-01-30T20:19:00.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28742025-01-30T20:19:00.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28752025-01-30T20:19:00.942ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28762025-01-30T20:19:00.944ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28772025-01-30T20:19:00.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28782025-01-30T20:19:00.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28792025-01-30T20:19:00.946ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28802025-01-30T20:19:00.947ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28812025-01-30T20:19:00.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28822025-01-30T20:19:00.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28832025-01-30T20:19:00.952ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 150.255171ms iteration = 6 status = {"physical_disks_added":0}
28842025-01-30T20:19:00.967ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28852025-01-30T20:19:00.967ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "db3a7ca4-6fd1-4f6f-a40f-65ab1e8b152c", "content-length": "1", "date": "Thu, 30 Jan 2025 20:19:00 GMT"} })
28862025-01-30T20:19:00.968ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28872025-01-30T20:19:00.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28882025-01-30T20:19:00.970ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 168.831235ms iteration = 4 status = null
28892025-01-30T20:19:01.058ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28902025-01-30T20:19:01.058ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28912025-01-30T20:19:01.059ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f5f479e-786d-41e8-8b64-d708da9681cf", "content-length": "372", "date": "Thu, 30 Jan 2025 20:19:01 GMT"} })
28922025-01-30T20:19:01.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28932025-01-30T20:19:01.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28942025-01-30T20:19:01.071ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28952025-01-30T20:19:01.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d68fae9-cece-424c-8ad7-cf4833845da0", "content-length": "691", "date": "Thu, 30 Jan 2025 20:19:01 GMT"} })
28962025-01-30T20:19:01.072ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
28972025-01-30T20:19:01.072ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
28982025-01-30T20:19:01.072ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
28992025-01-30T20:19:01.073ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 271.775523ms iteration = 4 status = {}
29002025-01-30T20:19:01.110ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
29012025-01-30T20:19:01.110ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29022025-01-30T20:19:01.110ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "aa87696c-9052-4a33-8e08-6ef18525f8b4", "date": "Thu, 30 Jan 2025 20:19:01 GMT"} })
29032025-01-30T20:19:01.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29042025-01-30T20:19:01.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29052025-01-30T20:19:01.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29062025-01-30T20:19:01.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29072025-01-30T20:19:01.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29082025-01-30T20:19:01.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29092025-01-30T20:19:01.122ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29102025-01-30T20:19:01.122ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29112025-01-30T20:19:01.123ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7b889cce-2b90-41e6-977b-12271afb9b91", "date": "Thu, 30 Jan 2025 20:19:01 GMT"} })
29122025-01-30T20:19:01.127ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 325.298308ms iteration = 4 status = {}
29132025-01-30T20:19:01.144ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
29142025-01-30T20:19:01.144ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29152025-01-30T20:19:01.145ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "42c16b33-f87a-4d3e-bcb9-4447f49d0bc7", "content-length": "26", "date": "Thu, 30 Jan 2025 20:19:00 GMT"} })
29162025-01-30T20:19:01.145ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29172025-01-30T20:19:01.146ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29182025-01-30T20:19:01.222ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 420.47467ms iteration = 4 status = {}
29192025-01-30T20:19:01.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29202025-01-30T20:19:01.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29212025-01-30T20:19:01.227ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
29222025-01-30T20:19:01.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29232025-01-30T20:19:01.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29242025-01-30T20:19:01.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 12a315dc-5a8c-453c-b5d1-b6fc244f3491 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29252025-01-30T20:19:01.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 12a315dc-5a8c-453c-b5d1-b6fc244f3491 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29262025-01-30T20:19:01.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 12a315dc-5a8c-453c-b5d1-b6fc244f3491 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29272025-01-30T20:19:01.433ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29282025-01-30T20:19:01.433ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbcf219d-15df-4c24-aa35-054526e751cc", "content-length": "134", "date": "Thu, 30 Jan 2025 20:19:00 GMT"} })
29292025-01-30T20:19:01.433ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29302025-01-30T20:19:01.433ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
29312025-01-30T20:19:01.433ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29322025-01-30T20:19:01.433ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29332025-01-30T20:19:01.433ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29342025-01-30T20:19:01.433ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29352025-01-30T20:19:01.433ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29362025-01-30T20:19:01.433ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29372025-01-30T20:19:01.434ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29382025-01-30T20:19:01.434ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29392025-01-30T20:19:01.434ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
29402025-01-30T20:19:01.434ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29412025-01-30T20:19:01.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29422025-01-30T20:19:01.436ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29432025-01-30T20:19:01.436ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee51f06a-93ec-44d4-939a-6025803fd72f", "content-length": "2", "date": "Thu, 30 Jan 2025 20:19:00 GMT"} })
29442025-01-30T20:19:01.436ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29452025-01-30T20:19:01.436ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "60cb0edf-3126-4662-aac6-05c29eca85db", "content-length": "52", "date": "Thu, 30 Jan 2025 20:19:00 GMT"} })
29462025-01-30T20:19:01.436ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
29472025-01-30T20:19:01.436ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29482025-01-30T20:19:01.547ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3edda81f-7b7a-4b7d-aaf4-c4141c2c3003", "date": "Thu, 30 Jan 2025 20:19:01 GMT"} })
29492025-01-30T20:19:01.547ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
29502025-01-30T20:19:01.547ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29512025-01-30T20:19:01.547ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f990e6d9-65f7-46b7-832b-02706c3fa6e2", "content-length": "682", "date": "Thu, 30 Jan 2025 20:19:01 GMT"} })
29522025-01-30T20:19:01.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29532025-01-30T20:19:01.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29542025-01-30T20:19:01.556ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29552025-01-30T20:19:01.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29562025-01-30T20:19:01.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29572025-01-30T20:19:01.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29582025-01-30T20:19:01.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29592025-01-30T20:19:01.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29602025-01-30T20:19:01.580ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 778.29676ms iteration = 4 status = {}
29612025-01-30T20:19:02.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = c44dc8be-24dd-4f8f-bbb7-40c5790fcfa3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
29622025-01-30T20:19:02.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = c44dc8be-24dd-4f8f-bbb7-40c5790fcfa3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
29632025-01-30T20:19:02.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = c44dc8be-24dd-4f8f-bbb7-40c5790fcfa3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
29642025-01-30T20:19:02.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = b80518b4-633e-44fe-af77-313aad9711b6 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
29652025-01-30T20:19:02.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = b80518b4-633e-44fe-af77-313aad9711b6 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
29662025-01-30T20:19:02.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = b80518b4-633e-44fe-af77-313aad9711b6 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
29672025-01-30T20:19:02.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = dc74d71a-8971-490d-85a0-d0b7a4312cd4 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
29682025-01-30T20:19:02.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = dc74d71a-8971-490d-85a0-d0b7a4312cd4 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
29692025-01-30T20:19:02.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48750 req_id = dc74d71a-8971-490d-85a0-d0b7a4312cd4 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
29702025-01-30T20:19:02.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 498 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 64532754-a221-46a4-b56f-1926be99630f response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
29712025-01-30T20:19:02.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f2d0e5a4-2881-4147-bba7-53abcdc06cc8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29722025-01-30T20:19:02.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f2d0e5a4-2881-4147-bba7-53abcdc06cc8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29732025-01-30T20:19:02.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f2d0e5a4-2881-4147-bba7-53abcdc06cc8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29742025-01-30T20:19:03.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a85330d-8a3b-40b9-816f-91bc58b21133 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29752025-01-30T20:19:03.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a85330d-8a3b-40b9-816f-91bc58b21133 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29762025-01-30T20:19:03.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a85330d-8a3b-40b9-816f-91bc58b21133 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29772025-01-30T20:19:04.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ddb723bd-9f36-4feb-a729-415ca7a147c6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29782025-01-30T20:19:04.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ddb723bd-9f36-4feb-a729-415ca7a147c6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29792025-01-30T20:19:04.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ddb723bd-9f36-4feb-a729-415ca7a147c6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29802025-01-30T20:19:05.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 92c20fe7-f7b8-41d3-9682-1964365d8531 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29812025-01-30T20:19:05.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 92c20fe7-f7b8-41d3-9682-1964365d8531 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29822025-01-30T20:19:05.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 92c20fe7-f7b8-41d3-9682-1964365d8531 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29832025-01-30T20:19:06.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a6626d64-26ea-4dc7-b1eb-9a202a14d656 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29842025-01-30T20:19:06.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a6626d64-26ea-4dc7-b1eb-9a202a14d656 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29852025-01-30T20:19:06.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a6626d64-26ea-4dc7-b1eb-9a202a14d656 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29862025-01-30T20:19:07.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7e58553a-e64e-42f6-9d38-41b722405c2e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29872025-01-30T20:19:07.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7e58553a-e64e-42f6-9d38-41b722405c2e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29882025-01-30T20:19:07.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7e58553a-e64e-42f6-9d38-41b722405c2e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29892025-01-30T20:19:08.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d474fe4c-dd24-4d73-90d5-42aceafea332 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29902025-01-30T20:19:08.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d474fe4c-dd24-4d73-90d5-42aceafea332 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29912025-01-30T20:19:08.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d474fe4c-dd24-4d73-90d5-42aceafea332 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29922025-01-30T20:19:09.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 85fe78d1-5e56-4d52-a819-700f3aaf9c7c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29932025-01-30T20:19:09.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 85fe78d1-5e56-4d52-a819-700f3aaf9c7c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29942025-01-30T20:19:09.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 85fe78d1-5e56-4d52-a819-700f3aaf9c7c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29952025-01-30T20:19:10.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c9a8ed66-38a2-4319-b02f-097a60f15ae7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29962025-01-30T20:19:10.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c9a8ed66-38a2-4319-b02f-097a60f15ae7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29972025-01-30T20:19:10.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c9a8ed66-38a2-4319-b02f-097a60f15ae7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
29982025-01-30T20:19:10.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
29992025-01-30T20:19:10.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
30002025-01-30T20:19:10.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30012025-01-30T20:19:10.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30022025-01-30T20:19:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30032025-01-30T20:19:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30042025-01-30T20:19:10.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30052025-01-30T20:19:10.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30062025-01-30T20:19:10.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30072025-01-30T20:19:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30082025-01-30T20:19:10.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30092025-01-30T20:19:10.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30102025-01-30T20:19:10.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30112025-01-30T20:19:10.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30122025-01-30T20:19:10.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30132025-01-30T20:19:10.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
30142025-01-30T20:19:10.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30152025-01-30T20:19:10.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30162025-01-30T20:19:10.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
30172025-01-30T20:19:10.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.502158ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
30182025-01-30T20:19:10.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.712745ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30192025-01-30T20:19:11.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 36ae958a-bbcb-4bb7-82bf-f76cd2ccc271 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30202025-01-30T20:19:11.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 36ae958a-bbcb-4bb7-82bf-f76cd2ccc271 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30212025-01-30T20:19:11.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 36ae958a-bbcb-4bb7-82bf-f76cd2ccc271 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30222025-01-30T20:19:12.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 505 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = ed76bcfa-ecb0-4de6-ad6d-ec10f441dcb3 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
30232025-01-30T20:19:12.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 92e9c223-721d-40b7-9f8d-51bbb87999d9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30242025-01-30T20:19:12.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 92e9c223-721d-40b7-9f8d-51bbb87999d9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30252025-01-30T20:19:12.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 92e9c223-721d-40b7-9f8d-51bbb87999d9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30262025-01-30T20:19:13.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 427a0918-0d02-42cc-923a-10201b3609bf roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30272025-01-30T20:19:13.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 427a0918-0d02-42cc-923a-10201b3609bf resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30282025-01-30T20:19:13.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 427a0918-0d02-42cc-923a-10201b3609bf response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30292025-01-30T20:19:14.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c7f2152e-3ea8-46b2-a78a-c0df53230de8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30302025-01-30T20:19:14.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c7f2152e-3ea8-46b2-a78a-c0df53230de8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30312025-01-30T20:19:14.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c7f2152e-3ea8-46b2-a78a-c0df53230de8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30322025-01-30T20:19:15.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1371f759-2109-4124-b827-0a5775669dc1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30332025-01-30T20:19:15.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1371f759-2109-4124-b827-0a5775669dc1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30342025-01-30T20:19:15.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1371f759-2109-4124-b827-0a5775669dc1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30352025-01-30T20:19:16.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b16b2783-b550-481f-8ad7-9834abdf6307 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30362025-01-30T20:19:16.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b16b2783-b550-481f-8ad7-9834abdf6307 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30372025-01-30T20:19:16.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b16b2783-b550-481f-8ad7-9834abdf6307 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30382025-01-30T20:19:17.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 57bec542-a436-4ef1-9b8d-69c6be640020 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30392025-01-30T20:19:17.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 57bec542-a436-4ef1-9b8d-69c6be640020 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30402025-01-30T20:19:17.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 57bec542-a436-4ef1-9b8d-69c6be640020 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30412025-01-30T20:19:18.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9ea2590a-8720-4e7c-8f5b-ef941d1d86e6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30422025-01-30T20:19:18.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9ea2590a-8720-4e7c-8f5b-ef941d1d86e6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30432025-01-30T20:19:18.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9ea2590a-8720-4e7c-8f5b-ef941d1d86e6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30442025-01-30T20:19:19.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd4df08a-cf35-4fa2-ae2f-71aaef28613b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30452025-01-30T20:19:19.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd4df08a-cf35-4fa2-ae2f-71aaef28613b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30462025-01-30T20:19:19.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd4df08a-cf35-4fa2-ae2f-71aaef28613b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30472025-01-30T20:19:20.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
30482025-01-30T20:19:20.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30492025-01-30T20:19:20.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
30502025-01-30T20:19:20.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30512025-01-30T20:19:20.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30522025-01-30T20:19:20.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30532025-01-30T20:19:20.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30542025-01-30T20:19:20.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30552025-01-30T20:19:20.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30562025-01-30T20:19:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30572025-01-30T20:19:20.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30582025-01-30T20:19:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30592025-01-30T20:19:20.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.589195ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30602025-01-30T20:19:20.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30612025-01-30T20:19:20.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30622025-01-30T20:19:20.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30632025-01-30T20:19:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
30642025-01-30T20:19:20.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30652025-01-30T20:19:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30662025-01-30T20:19:20.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
30672025-01-30T20:19:20.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.471441ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
30682025-01-30T20:19:20.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7105381d-1552-4e57-b7ec-66d27badca87 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30692025-01-30T20:19:20.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7105381d-1552-4e57-b7ec-66d27badca87 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30702025-01-30T20:19:20.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7105381d-1552-4e57-b7ec-66d27badca87 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30712025-01-30T20:19:21.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 51a6e471-cd6f-4698-abc4-fef90cdd1089 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30722025-01-30T20:19:21.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 51a6e471-cd6f-4698-abc4-fef90cdd1089 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30732025-01-30T20:19:21.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 51a6e471-cd6f-4698-abc4-fef90cdd1089 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30742025-01-30T20:19:22.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 495 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 212a6fe1-c1d1-4a78-ba95-623feac0ee1d response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
30752025-01-30T20:19:22.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 449a1bd5-b8e9-4a38-8d90-14ccf17aa66f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30762025-01-30T20:19:22.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 449a1bd5-b8e9-4a38-8d90-14ccf17aa66f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30772025-01-30T20:19:22.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 449a1bd5-b8e9-4a38-8d90-14ccf17aa66f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30782025-01-30T20:19:23.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3a1492ec-fbfc-4285-ba3c-294b7f69aacc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30792025-01-30T20:19:23.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3a1492ec-fbfc-4285-ba3c-294b7f69aacc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30802025-01-30T20:19:23.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3a1492ec-fbfc-4285-ba3c-294b7f69aacc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30812025-01-30T20:19:24.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e474d547-4396-4d9d-bd96-62f21a91ff83 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30822025-01-30T20:19:24.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e474d547-4396-4d9d-bd96-62f21a91ff83 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30832025-01-30T20:19:24.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e474d547-4396-4d9d-bd96-62f21a91ff83 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30842025-01-30T20:19:25.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8269e63a-9ddf-4a7c-a6e9-2ae59f0775d3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30852025-01-30T20:19:25.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8269e63a-9ddf-4a7c-a6e9-2ae59f0775d3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30862025-01-30T20:19:25.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8269e63a-9ddf-4a7c-a6e9-2ae59f0775d3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30872025-01-30T20:19:26.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c16f54f6-2bc1-4f76-9891-79ccc606cced roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30882025-01-30T20:19:26.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c16f54f6-2bc1-4f76-9891-79ccc606cced resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30892025-01-30T20:19:26.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c16f54f6-2bc1-4f76-9891-79ccc606cced response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30902025-01-30T20:19:27.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 052f658b-ac0d-4d7f-b83d-fd2c3b0074f1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30912025-01-30T20:19:27.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 052f658b-ac0d-4d7f-b83d-fd2c3b0074f1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30922025-01-30T20:19:27.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 052f658b-ac0d-4d7f-b83d-fd2c3b0074f1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30932025-01-30T20:19:29.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4ff99f8c-9edc-460f-b895-df7a783b9114 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30942025-01-30T20:19:29.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4ff99f8c-9edc-460f-b895-df7a783b9114 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30952025-01-30T20:19:29.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4ff99f8c-9edc-460f-b895-df7a783b9114 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30962025-01-30T20:19:30.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 15245d7e-4054-4e48-b50a-fcdfc920aeae roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30972025-01-30T20:19:30.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 15245d7e-4054-4e48-b50a-fcdfc920aeae resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30982025-01-30T20:19:30.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 15245d7e-4054-4e48-b50a-fcdfc920aeae response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
30992025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
31002025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
31012025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31022025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
31032025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31042025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
31052025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
31062025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
31072025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31082025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
31092025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
31102025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31112025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31122025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
31132025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31142025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
31152025-01-30T20:19:30.801ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
31162025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
31172025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31182025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31192025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
31202025-01-30T20:19:30.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
31212025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
31222025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.42\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
31232025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31242025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
31252025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
31262025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31272025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31282025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
31292025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31302025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
31312025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
31322025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31332025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31342025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
31352025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
31362025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
31372025-01-30T20:19:30.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:09:30.801709397 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31382025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
31392025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31402025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31412025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31422025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
31432025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
31442025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31452025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31462025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
31472025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31482025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
31492025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
31502025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31512025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 5 reason = Timeout
31522025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
31532025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31542025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31552025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
31562025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
31572025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31582025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
31592025-01-30T20:19:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31602025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
31612025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31622025-01-30T20:19:30.802ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31632025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31642025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
31652025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31662025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31672025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31682025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31692025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31702025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31712025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31722025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31732025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31742025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31752025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31762025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31772025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31782025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31792025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31802025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31812025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31822025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31832025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
31842025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31852025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31862025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31872025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31882025-01-30T20:19:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2322, tv_nsec: 12576106 } })
31892025-01-30T20:19:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2322, tv_nsec: 12581176 } })
31902025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
31912025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.260645ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
31922025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
31932025-01-30T20:19:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.169972ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
31942025-01-30T20:19:30.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31952025-01-30T20:19:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.112184ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
31962025-01-30T20:19:30.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.529646ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31972025-01-30T20:19:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31982025-01-30T20:19:30.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31992025-01-30T20:19:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32002025-01-30T20:19:30.807ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
32012025-01-30T20:19:30.807ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
32022025-01-30T20:19:30.807ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 6.112629ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
32032025-01-30T20:19:30.808ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32042025-01-30T20:19:30.808ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32052025-01-30T20:19:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32062025-01-30T20:19:30.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32072025-01-30T20:19:30.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32082025-01-30T20:19:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32092025-01-30T20:19:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32102025-01-30T20:19:30.810ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32112025-01-30T20:19:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32122025-01-30T20:19:30.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32132025-01-30T20:19:30.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32142025-01-30T20:19:30.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32152025-01-30T20:19:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32162025-01-30T20:19:30.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32172025-01-30T20:19:30.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32182025-01-30T20:19:30.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32192025-01-30T20:19:30.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32202025-01-30T20:19:30.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32212025-01-30T20:19:30.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2322, tv_nsec: 24352493 } })
32222025-01-30T20:19:30.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
32232025-01-30T20:19:30.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32242025-01-30T20:19:30.814ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:09:30.801709397 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32252025-01-30T20:19:30.814ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.227047ms iteration = 3 status = {"expiration":"2025-01-30T20:09:30.801709397Z","pruned":[]}
32262025-01-30T20:19:30.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32272025-01-30T20:19:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32282025-01-30T20:19:30.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32292025-01-30T20:19:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32302025-01-30T20:19:30.818ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.334473ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
32312025-01-30T20:19:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32322025-01-30T20:19:30.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32332025-01-30T20:19:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32342025-01-30T20:19:30.820ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32352025-01-30T20:19:30.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2322, tv_nsec: 31701837 } })
32362025-01-30T20:19:30.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
32372025-01-30T20:19:30.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32382025-01-30T20:19:30.822ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32392025-01-30T20:19:30.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32402025-01-30T20:19:30.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32412025-01-30T20:19:30.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32422025-01-30T20:19:30.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32432025-01-30T20:19:30.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32442025-01-30T20:19:30.828ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32452025-01-30T20:19:30.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32462025-01-30T20:19:30.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32472025-01-30T20:19:30.831ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
32482025-01-30T20:19:30.831ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
32492025-01-30T20:19:30.831ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
32502025-01-30T20:19:30.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32512025-01-30T20:19:30.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32522025-01-30T20:19:30.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32532025-01-30T20:19:30.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32542025-01-30T20:19:30.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32552025-01-30T20:19:30.835ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32562025-01-30T20:19:30.835ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2322, tv_nsec: 45455759 } })
32572025-01-30T20:19:30.835ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
32582025-01-30T20:19:30.836ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32592025-01-30T20:19:30.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32602025-01-30T20:19:30.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32612025-01-30T20:19:30.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32622025-01-30T20:19:30.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32632025-01-30T20:19:30.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32642025-01-30T20:19:30.839ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32652025-01-30T20:19:30.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32662025-01-30T20:19:30.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32672025-01-30T20:19:30.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32682025-01-30T20:19:30.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32692025-01-30T20:19:30.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.37606ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
32702025-01-30T20:19:30.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32712025-01-30T20:19:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32722025-01-30T20:19:30.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32732025-01-30T20:19:30.857ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32742025-01-30T20:19:30.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32752025-01-30T20:19:30.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32762025-01-30T20:19:30.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32772025-01-30T20:19:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32782025-01-30T20:19:30.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.772581ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32792025-01-30T20:19:30.861ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32802025-01-30T20:19:30.861ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32812025-01-30T20:19:30.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32822025-01-30T20:19:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32832025-01-30T20:19:30.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32842025-01-30T20:19:30.869ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
32852025-01-30T20:19:30.869ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
32862025-01-30T20:19:30.869ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 67.73745ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
32872025-01-30T20:19:30.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32882025-01-30T20:19:30.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
32892025-01-30T20:19:30.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32902025-01-30T20:19:30.871ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32912025-01-30T20:19:30.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32922025-01-30T20:19:30.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32932025-01-30T20:19:30.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32942025-01-30T20:19:30.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32952025-01-30T20:19:30.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32962025-01-30T20:19:30.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32972025-01-30T20:19:30.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 72.173953ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32982025-01-30T20:19:30.874ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32992025-01-30T20:19:30.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33002025-01-30T20:19:30.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33012025-01-30T20:19:30.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33022025-01-30T20:19:30.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33032025-01-30T20:19:30.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33042025-01-30T20:19:30.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33052025-01-30T20:19:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33062025-01-30T20:19:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
33072025-01-30T20:19:30.877ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33082025-01-30T20:19:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33092025-01-30T20:19:30.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33102025-01-30T20:19:30.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33112025-01-30T20:19:30.880ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33122025-01-30T20:19:30.880ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33132025-01-30T20:19:30.880ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33142025-01-30T20:19:30.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33152025-01-30T20:19:30.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33162025-01-30T20:19:30.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33172025-01-30T20:19:30.882ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
33182025-01-30T20:19:30.882ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.238734ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
33192025-01-30T20:19:30.883ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
33202025-01-30T20:19:30.883ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
33212025-01-30T20:19:30.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33222025-01-30T20:19:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33232025-01-30T20:19:30.883ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33242025-01-30T20:19:30.883ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.13832ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33252025-01-30T20:19:30.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33262025-01-30T20:19:30.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33272025-01-30T20:19:30.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33282025-01-30T20:19:30.892ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 90.823831ms iteration = 7 status = {"physical_disks_added":0}
33292025-01-30T20:19:30.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33302025-01-30T20:19:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33312025-01-30T20:19:30.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.055866ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33322025-01-30T20:19:30.902ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33332025-01-30T20:19:30.902ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33342025-01-30T20:19:30.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33352025-01-30T20:19:30.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33362025-01-30T20:19:30.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33372025-01-30T20:19:30.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33382025-01-30T20:19:30.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33392025-01-30T20:19:30.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33402025-01-30T20:19:30.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.254904ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
33412025-01-30T20:19:30.914ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
33422025-01-30T20:19:30.914ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 112.43034ms iteration = 5 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
33432025-01-30T20:19:30.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33442025-01-30T20:19:30.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33452025-01-30T20:19:30.984ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
33462025-01-30T20:19:30.984ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33472025-01-30T20:19:30.984ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2445d149-1dae-41da-a163-5494d4441e48", "content-length": "26", "date": "Thu, 30 Jan 2025 20:19:30 GMT"} })
33482025-01-30T20:19:30.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33492025-01-30T20:19:30.985ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33502025-01-30T20:19:31.019ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
33512025-01-30T20:19:31.019ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33522025-01-30T20:19:31.020ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb3cc1c3-6603-4735-b355-36944ecb57e4", "content-length": "26", "date": "Thu, 30 Jan 2025 20:19:30 GMT"} })
33532025-01-30T20:19:31.020ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33542025-01-30T20:19:31.021ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
33552025-01-30T20:19:31.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1911cc01-71a9-4930-8725-35e016558ee8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
33562025-01-30T20:19:31.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1911cc01-71a9-4930-8725-35e016558ee8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
33572025-01-30T20:19:31.051ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
33582025-01-30T20:19:31.051ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33592025-01-30T20:19:31.052ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4949ce9e-e890-4efe-94ac-4eec9cbd45df", "content-length": "26", "date": "Thu, 30 Jan 2025 20:19:30 GMT"} })
33602025-01-30T20:19:31.052ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33612025-01-30T20:19:31.053ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33622025-01-30T20:19:31.107ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
33632025-01-30T20:19:31.115ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33642025-01-30T20:19:31.168ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33652025-01-30T20:19:31.168ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33662025-01-30T20:19:31.169ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a477db7-e3fb-486a-ae31-53b09c6c0e23", "content-length": "372", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} })
33672025-01-30T20:19:31.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33682025-01-30T20:19:31.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33692025-01-30T20:19:31.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33702025-01-30T20:19:31.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33712025-01-30T20:19:31.175ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33722025-01-30T20:19:31.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33732025-01-30T20:19:31.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33742025-01-30T20:19:31.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33752025-01-30T20:19:31.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1911cc01-71a9-4930-8725-35e016558ee8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
33762025-01-30T20:19:31.182ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
33772025-01-30T20:19:31.182ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33782025-01-30T20:19:31.182ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-30 20:18:12.536035 UTC dns_group = internal generation = 1
33792025-01-30T20:19:31.182ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 380.524812ms iteration = 3 status = {"generation":1}
33802025-01-30T20:19:31.226ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33812025-01-30T20:19:31.226ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33822025-01-30T20:19:31.226ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 424.699867ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33832025-01-30T20:19:31.227ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33842025-01-30T20:19:31.227ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
33852025-01-30T20:19:31.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33862025-01-30T20:19:31.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33872025-01-30T20:19:31.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33882025-01-30T20:19:31.232ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33892025-01-30T20:19:31.233ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33902025-01-30T20:19:31.234ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "91312bbe-a71a-4eb4-9bc6-46924ac8e7ae", "content-length": "1", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} })
33912025-01-30T20:19:31.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33922025-01-30T20:19:31.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33932025-01-30T20:19:31.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33942025-01-30T20:19:31.235ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33952025-01-30T20:19:31.235ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33962025-01-30T20:19:31.235ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33972025-01-30T20:19:31.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33982025-01-30T20:19:31.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33992025-01-30T20:19:31.240ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 438.935652ms iteration = 5 status = null
34002025-01-30T20:19:31.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34012025-01-30T20:19:31.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
34022025-01-30T20:19:31.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34032025-01-30T20:19:31.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34042025-01-30T20:19:31.262ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 460.45558ms iteration = 5 status = 0
34052025-01-30T20:19:31.264ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
34062025-01-30T20:19:31.264ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34072025-01-30T20:19:31.264ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-30 20:18:13.133071 UTC dns_group = external generation = 2
34082025-01-30T20:19:31.264ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 462.97813ms iteration = 3 status = {"generation":2}
34092025-01-30T20:19:31.274ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
34102025-01-30T20:19:31.274ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34112025-01-30T20:19:31.275ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1c2e300b-f74b-4b7d-bc42-041f2229220d", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} })
34122025-01-30T20:19:31.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34132025-01-30T20:19:31.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34142025-01-30T20:19:31.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34152025-01-30T20:19:31.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34162025-01-30T20:19:31.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34172025-01-30T20:19:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34182025-01-30T20:19:31.289ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
34192025-01-30T20:19:31.289ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34202025-01-30T20:19:31.290ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8f862952-f252-42fd-8dde-2bee0b82c33f", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} })
34212025-01-30T20:19:31.292ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 490.196766ms iteration = 5 status = {}
34222025-01-30T20:19:31.314ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 512.781242ms iteration = 5 status = {}
34232025-01-30T20:19:31.325ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) }
34242025-01-30T20:19:31.325ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 523.87103ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34252025-01-30T20:19:31.326ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34262025-01-30T20:19:31.363ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
34272025-01-30T20:19:31.363ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 561.287108ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
34282025-01-30T20:19:31.371ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34292025-01-30T20:19:31.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34302025-01-30T20:19:31.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34312025-01-30T20:19:31.377ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34322025-01-30T20:19:31.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34332025-01-30T20:19:31.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34342025-01-30T20:19:31.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34352025-01-30T20:19:31.384ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34362025-01-30T20:19:31.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34372025-01-30T20:19:31.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34382025-01-30T20:19:31.436ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
34392025-01-30T20:19:31.436ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9cc895c2-8fcb-4608-b750-9b432015ec34", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34402025-01-30T20:19:31.436ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34412025-01-30T20:19:31.438ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "289ba751-8b79-4738-b1a2-2b7822082dbd", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34422025-01-30T20:19:31.438ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34432025-01-30T20:19:31.440ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34442025-01-30T20:19:31.440ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 638.890663ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
34452025-01-30T20:19:31.481ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
34462025-01-30T20:19:31.482ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5e997e52-8424-4dc2-834f-a0f352e3ee0b", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34472025-01-30T20:19:31.482ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34482025-01-30T20:19:31.484ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e2c99b46-13f1-4ec2-ae78-18e592aba7e9", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34492025-01-30T20:19:31.484ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34502025-01-30T20:19:31.485ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3a3fd3fa-b0f9-481b-9c7f-f5c9c12b9a9d", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34512025-01-30T20:19:31.485ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34522025-01-30T20:19:31.487ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
34532025-01-30T20:19:31.487ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 685.893337ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
34542025-01-30T20:19:31.491ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34552025-01-30T20:19:31.491ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea0af6a4-9eee-4989-a506-a1e6f015622b", "content-length": "691", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} })
34562025-01-30T20:19:31.491ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
34572025-01-30T20:19:31.491ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
34582025-01-30T20:19:31.491ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
34592025-01-30T20:19:31.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34602025-01-30T20:19:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34612025-01-30T20:19:31.493ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 691.914783ms iteration = 5 status = {}
34622025-01-30T20:19:31.495ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
34632025-01-30T20:19:31.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34642025-01-30T20:19:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34652025-01-30T20:19:31.504ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34662025-01-30T20:19:31.504ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "881f0e79-1ea9-484d-a1f6-7f310cdf038a", "content-length": "134", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} })
34672025-01-30T20:19:31.504ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
34682025-01-30T20:19:31.504ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
34692025-01-30T20:19:31.505ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
34702025-01-30T20:19:31.505ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34712025-01-30T20:19:31.505ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34722025-01-30T20:19:31.505ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34732025-01-30T20:19:31.505ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34742025-01-30T20:19:31.505ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34752025-01-30T20:19:31.505ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34762025-01-30T20:19:31.505ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34772025-01-30T20:19:31.505ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
34782025-01-30T20:19:31.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34792025-01-30T20:19:31.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34802025-01-30T20:19:31.508ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34812025-01-30T20:19:31.508ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc7dc4dc-fa23-4d5d-aea8-7b8a3449f733", "content-length": "2", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} })
34822025-01-30T20:19:31.508ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
34832025-01-30T20:19:31.508ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e010715-c852-4dc0-b994-eb130a19eb3e", "content-length": "52", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} })
34842025-01-30T20:19:31.508ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
34852025-01-30T20:19:31.508ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
34862025-01-30T20:19:31.604ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "eba93efb-0a8a-4ace-aeec-1909f51289ef", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} })
34872025-01-30T20:19:31.604ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
34882025-01-30T20:19:31.604ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
34892025-01-30T20:19:31.604ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "23aea336-80a5-4a75-a595-b825845ebaf3", "content-length": "682", "date": "Thu, 30 Jan 2025 20:19:31 GMT"} })
34902025-01-30T20:19:31.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34912025-01-30T20:19:31.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34922025-01-30T20:19:31.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34932025-01-30T20:19:31.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34942025-01-30T20:19:31.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34952025-01-30T20:19:31.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34962025-01-30T20:19:31.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34972025-01-30T20:19:31.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34982025-01-30T20:19:31.622ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 820.42798ms iteration = 5 status = {}
34992025-01-30T20:19:32.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 42ce1ea9-52e5-4b9e-b324-57f8b2967260 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35002025-01-30T20:19:32.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 42ce1ea9-52e5-4b9e-b324-57f8b2967260 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35012025-01-30T20:19:32.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 42ce1ea9-52e5-4b9e-b324-57f8b2967260 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35022025-01-30T20:19:32.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = d79ded44-1ffe-45c5-8dc4-bc1070f806c1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
35032025-01-30T20:19:32.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = d79ded44-1ffe-45c5-8dc4-bc1070f806c1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
35042025-01-30T20:19:32.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = d79ded44-1ffe-45c5-8dc4-bc1070f806c1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
35052025-01-30T20:19:32.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 522 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 47fa9e8e-fb3c-42c4-abb6-9c5770a234d1 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
35062025-01-30T20:19:33.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31820d2a-9b7d-4b2b-9197-35d666357250 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35072025-01-30T20:19:33.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31820d2a-9b7d-4b2b-9197-35d666357250 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35082025-01-30T20:19:33.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31820d2a-9b7d-4b2b-9197-35d666357250 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35092025-01-30T20:19:34.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e9239c39-2c53-4d85-b8e5-0965cc7b873b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35102025-01-30T20:19:34.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e9239c39-2c53-4d85-b8e5-0965cc7b873b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35112025-01-30T20:19:34.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e9239c39-2c53-4d85-b8e5-0965cc7b873b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35122025-01-30T20:19:35.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6611cabd-3045-45cc-b0f5-f63dbaffe69d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35132025-01-30T20:19:35.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6611cabd-3045-45cc-b0f5-f63dbaffe69d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35142025-01-30T20:19:35.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6611cabd-3045-45cc-b0f5-f63dbaffe69d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35152025-01-30T20:19:36.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 05c4b11f-e64a-4286-b27f-0b8088a4778e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35162025-01-30T20:19:36.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 05c4b11f-e64a-4286-b27f-0b8088a4778e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35172025-01-30T20:19:36.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 05c4b11f-e64a-4286-b27f-0b8088a4778e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35182025-01-30T20:19:37.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 79f49b8c-9bd7-46cc-9d93-f9e20504e67b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35192025-01-30T20:19:37.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 79f49b8c-9bd7-46cc-9d93-f9e20504e67b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35202025-01-30T20:19:37.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 79f49b8c-9bd7-46cc-9d93-f9e20504e67b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35212025-01-30T20:19:38.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6085e747-ca40-40ea-a4f6-5074307f75e6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35222025-01-30T20:19:38.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6085e747-ca40-40ea-a4f6-5074307f75e6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35232025-01-30T20:19:38.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6085e747-ca40-40ea-a4f6-5074307f75e6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35242025-01-30T20:19:39.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 29ff8f82-c3b4-4f47-9429-93e929e3f11a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35252025-01-30T20:19:39.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 29ff8f82-c3b4-4f47-9429-93e929e3f11a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35262025-01-30T20:19:39.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 29ff8f82-c3b4-4f47-9429-93e929e3f11a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35272025-01-30T20:19:40.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cb15cbba-0c92-4447-ba15-59098aa2349c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35282025-01-30T20:19:40.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cb15cbba-0c92-4447-ba15-59098aa2349c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35292025-01-30T20:19:40.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cb15cbba-0c92-4447-ba15-59098aa2349c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35302025-01-30T20:19:40.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
35312025-01-30T20:19:40.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35322025-01-30T20:19:40.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
35332025-01-30T20:19:40.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35342025-01-30T20:19:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35352025-01-30T20:19:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35362025-01-30T20:19:40.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35372025-01-30T20:19:40.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35382025-01-30T20:19:40.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35392025-01-30T20:19:40.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35402025-01-30T20:19:40.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35412025-01-30T20:19:40.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35422025-01-30T20:19:40.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35432025-01-30T20:19:40.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
35442025-01-30T20:19:40.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35452025-01-30T20:19:40.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35462025-01-30T20:19:40.827ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
35472025-01-30T20:19:40.827ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.136387ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
35482025-01-30T20:19:40.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35492025-01-30T20:19:40.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35502025-01-30T20:19:40.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.584146ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35512025-01-30T20:19:41.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bd79e417-99a4-4358-86b2-6fab7c05cbe5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35522025-01-30T20:19:41.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bd79e417-99a4-4358-86b2-6fab7c05cbe5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35532025-01-30T20:19:41.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bd79e417-99a4-4358-86b2-6fab7c05cbe5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35542025-01-30T20:19:42.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = da72fc33-6b85-42a8-a55e-258a7aae0200 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35552025-01-30T20:19:42.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = da72fc33-6b85-42a8-a55e-258a7aae0200 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35562025-01-30T20:19:42.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = da72fc33-6b85-42a8-a55e-258a7aae0200 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35572025-01-30T20:19:42.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 538 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 30c82661-c428-4605-a98b-ed87a3008c43 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
35582025-01-30T20:19:43.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cae94180-164b-4744-b0bd-b786d0a729e4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35592025-01-30T20:19:43.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cae94180-164b-4744-b0bd-b786d0a729e4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35602025-01-30T20:19:43.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cae94180-164b-4744-b0bd-b786d0a729e4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35612025-01-30T20:19:44.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e51d068c-4b8b-4fbb-81c3-6cf66701e937 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35622025-01-30T20:19:44.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e51d068c-4b8b-4fbb-81c3-6cf66701e937 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35632025-01-30T20:19:44.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e51d068c-4b8b-4fbb-81c3-6cf66701e937 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35642025-01-30T20:19:45.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 93ba26ca-6057-4de4-97c0-bcd488040536 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35652025-01-30T20:19:45.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 93ba26ca-6057-4de4-97c0-bcd488040536 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35662025-01-30T20:19:45.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 93ba26ca-6057-4de4-97c0-bcd488040536 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35672025-01-30T20:19:46.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ace388c0-19f6-4bdc-a5b0-e8076fd6babc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35682025-01-30T20:19:46.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ace388c0-19f6-4bdc-a5b0-e8076fd6babc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35692025-01-30T20:19:46.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ace388c0-19f6-4bdc-a5b0-e8076fd6babc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35702025-01-30T20:19:47.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 554a46c7-65f6-47e3-a690-d0018b638073 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35712025-01-30T20:19:47.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 554a46c7-65f6-47e3-a690-d0018b638073 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35722025-01-30T20:19:47.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 554a46c7-65f6-47e3-a690-d0018b638073 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35732025-01-30T20:19:48.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bc0cd190-c9a4-495f-9c9d-01770e679ee3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35742025-01-30T20:19:48.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bc0cd190-c9a4-495f-9c9d-01770e679ee3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35752025-01-30T20:19:48.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bc0cd190-c9a4-495f-9c9d-01770e679ee3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35762025-01-30T20:19:49.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c1105f8d-1434-4328-9e2e-42dbe3794070 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35772025-01-30T20:19:49.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c1105f8d-1434-4328-9e2e-42dbe3794070 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35782025-01-30T20:19:49.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c1105f8d-1434-4328-9e2e-42dbe3794070 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35792025-01-30T20:19:50.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 53ba5339-63f9-4805-a658-3ba0d2a60995 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35802025-01-30T20:19:50.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 53ba5339-63f9-4805-a658-3ba0d2a60995 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35812025-01-30T20:19:50.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 53ba5339-63f9-4805-a658-3ba0d2a60995 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
35822025-01-30T20:19:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
35832025-01-30T20:19:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35842025-01-30T20:19:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
35852025-01-30T20:19:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35862025-01-30T20:19:50.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35872025-01-30T20:19:50.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35882025-01-30T20:19:50.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35892025-01-30T20:19:50.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35902025-01-30T20:19:50.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35912025-01-30T20:19:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35922025-01-30T20:19:50.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35932025-01-30T20:19:50.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35942025-01-30T20:19:50.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.991816ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35952025-01-30T20:19:50.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35962025-01-30T20:19:50.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35972025-01-30T20:19:50.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35982025-01-30T20:19:50.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
35992025-01-30T20:19:50.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36002025-01-30T20:19:50.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36012025-01-30T20:19:50.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
36022025-01-30T20:19:50.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.691495ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
36032025-01-30T20:19:51.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 05421b24-60a2-4858-b85c-70fe69d907f2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36042025-01-30T20:19:51.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 05421b24-60a2-4858-b85c-70fe69d907f2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36052025-01-30T20:19:51.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 05421b24-60a2-4858-b85c-70fe69d907f2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36062025-01-30T20:19:52.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 653 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 5528884f-9071-45a0-b5dc-1c87f9ef56a8 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
36072025-01-30T20:19:52.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 18943783-4c88-43d8-9d7a-294a6c18d228 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36082025-01-30T20:19:52.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 18943783-4c88-43d8-9d7a-294a6c18d228 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36092025-01-30T20:19:52.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 18943783-4c88-43d8-9d7a-294a6c18d228 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36102025-01-30T20:19:53.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2a6ae6e5-d046-41fd-b8d0-27297c7f975c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36112025-01-30T20:19:53.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2a6ae6e5-d046-41fd-b8d0-27297c7f975c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36122025-01-30T20:19:53.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2a6ae6e5-d046-41fd-b8d0-27297c7f975c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36132025-01-30T20:19:54.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f0e63234-64dd-4465-855c-4a24ba3a707f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36142025-01-30T20:19:54.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f0e63234-64dd-4465-855c-4a24ba3a707f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36152025-01-30T20:19:54.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f0e63234-64dd-4465-855c-4a24ba3a707f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36162025-01-30T20:19:55.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5d5be8d6-364f-40cb-98a0-c424eec271dd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36172025-01-30T20:19:55.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5d5be8d6-364f-40cb-98a0-c424eec271dd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36182025-01-30T20:19:55.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5d5be8d6-364f-40cb-98a0-c424eec271dd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36192025-01-30T20:19:56.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = efe83749-c11f-4496-96ac-7d76fb66cde8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36202025-01-30T20:19:56.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = efe83749-c11f-4496-96ac-7d76fb66cde8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36212025-01-30T20:19:56.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = efe83749-c11f-4496-96ac-7d76fb66cde8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36222025-01-30T20:19:57.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 83eafeee-e760-4619-81a0-e845ff080de3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36232025-01-30T20:19:57.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 83eafeee-e760-4619-81a0-e845ff080de3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36242025-01-30T20:19:57.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 83eafeee-e760-4619-81a0-e845ff080de3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36252025-01-30T20:19:58.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0610fc9a-4b6c-4389-bd26-ee278bc5d70e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36262025-01-30T20:19:58.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0610fc9a-4b6c-4389-bd26-ee278bc5d70e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36272025-01-30T20:19:58.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0610fc9a-4b6c-4389-bd26-ee278bc5d70e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36282025-01-30T20:19:59.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 50582a52-e65f-406d-a5f3-a4d3d83ad754 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36292025-01-30T20:19:59.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 50582a52-e65f-406d-a5f3-a4d3d83ad754 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36302025-01-30T20:19:59.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 50582a52-e65f-406d-a5f3-a4d3d83ad754 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36312025-01-30T20:20:00.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
36322025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
36332025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36342025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36352025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
36362025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36372025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
36382025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
36392025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36402025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
36412025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36422025-01-30T20:20:00.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36432025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36442025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
36452025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36462025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
36472025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36482025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 6 reason = Timeout
36492025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36502025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
36512025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36522025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36532025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
36542025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36552025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
36562025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36572025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
36582025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36592025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
36602025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36612025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
36622025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
36632025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36642025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
36652025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
36662025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36672025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36682025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36692025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36702025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36712025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36722025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36732025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36742025-01-30T20:20:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36752025-01-30T20:20:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36762025-01-30T20:20:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36772025-01-30T20:20:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36782025-01-30T20:20:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
36792025-01-30T20:20:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36802025-01-30T20:20:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36812025-01-30T20:20:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36822025-01-30T20:20:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36832025-01-30T20:20:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36842025-01-30T20:20:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36852025-01-30T20:20:00.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d588996a-4c9f-4526-a82c-f1b2b9b20b82 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36862025-01-30T20:20:00.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d588996a-4c9f-4526-a82c-f1b2b9b20b82 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
36872025-01-30T20:20:00.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36882025-01-30T20:20:00.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36892025-01-30T20:20:00.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36902025-01-30T20:20:00.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.70551ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36912025-01-30T20:20:00.806ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36922025-01-30T20:20:00.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36932025-01-30T20:20:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36942025-01-30T20:20:00.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36952025-01-30T20:20:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36962025-01-30T20:20:00.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36972025-01-30T20:20:00.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36982025-01-30T20:20:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36992025-01-30T20:20:00.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37002025-01-30T20:20:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37012025-01-30T20:20:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
37022025-01-30T20:20:00.809ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37032025-01-30T20:20:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37042025-01-30T20:20:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37052025-01-30T20:20:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37062025-01-30T20:20:00.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37072025-01-30T20:20:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37082025-01-30T20:20:00.812ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37092025-01-30T20:20:00.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37102025-01-30T20:20:00.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2352, tv_nsec: 22619145 } })
37112025-01-30T20:20:00.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
37122025-01-30T20:20:00.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2352, tv_nsec: 24293952 } })
37132025-01-30T20:20:00.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
37142025-01-30T20:20:00.815ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.878635ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
37152025-01-30T20:20:00.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 13013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d588996a-4c9f-4526-a82c-f1b2b9b20b82 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
37162025-01-30T20:20:00.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37172025-01-30T20:20:00.817ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37182025-01-30T20:20:00.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37192025-01-30T20:20:00.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37202025-01-30T20:20:00.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37212025-01-30T20:20:00.818ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2352, tv_nsec: 28574200 } })
37222025-01-30T20:20:00.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
37232025-01-30T20:20:00.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37242025-01-30T20:20:00.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37252025-01-30T20:20:00.819ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37262025-01-30T20:20:00.819ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 18.150594ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37272025-01-30T20:20:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37282025-01-30T20:20:00.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37292025-01-30T20:20:00.853ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37302025-01-30T20:20:00.853ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37312025-01-30T20:20:00.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37322025-01-30T20:20:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37332025-01-30T20:20:00.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37342025-01-30T20:20:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37352025-01-30T20:20:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37362025-01-30T20:20:00.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37372025-01-30T20:20:00.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.148002ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37382025-01-30T20:20:00.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37392025-01-30T20:20:00.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37402025-01-30T20:20:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37412025-01-30T20:20:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37422025-01-30T20:20:00.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.172261ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
37432025-01-30T20:20:00.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37442025-01-30T20:20:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37452025-01-30T20:20:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37462025-01-30T20:20:00.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37472025-01-30T20:20:00.856ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37482025-01-30T20:20:00.856ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37492025-01-30T20:20:00.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37502025-01-30T20:20:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37512025-01-30T20:20:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37522025-01-30T20:20:00.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37532025-01-30T20:20:00.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37542025-01-30T20:20:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37552025-01-30T20:20:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
37562025-01-30T20:20:00.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37572025-01-30T20:20:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37582025-01-30T20:20:00.861ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37592025-01-30T20:20:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
37602025-01-30T20:20:00.863ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37612025-01-30T20:20:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37622025-01-30T20:20:00.877ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
37632025-01-30T20:20:00.877ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.060941ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
37642025-01-30T20:20:00.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37652025-01-30T20:20:00.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37662025-01-30T20:20:00.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37672025-01-30T20:20:00.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37682025-01-30T20:20:00.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37692025-01-30T20:20:00.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
37702025-01-30T20:20:00.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37712025-01-30T20:20:00.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37722025-01-30T20:20:00.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.284726ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37732025-01-30T20:20:00.892ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.340195ms iteration = 6 status = 0
37742025-01-30T20:20:00.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.632383ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37752025-01-30T20:20:00.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37762025-01-30T20:20:00.894ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37772025-01-30T20:20:00.894ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37782025-01-30T20:20:00.894ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.95985ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37792025-01-30T20:20:00.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37802025-01-30T20:20:00.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37812025-01-30T20:20:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37822025-01-30T20:20:00.898ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
37832025-01-30T20:20:00.898ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 97.559258ms iteration = 6 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
37842025-01-30T20:20:00.910ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
37852025-01-30T20:20:00.910ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37862025-01-30T20:20:00.910ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78057589-a7bc-4089-94bb-76c3851031dc", "content-length": "26", "date": "Thu, 30 Jan 2025 20:20:00 GMT"} })
37872025-01-30T20:20:00.910ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37882025-01-30T20:20:00.911ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37892025-01-30T20:20:00.912ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
37902025-01-30T20:20:00.912ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37912025-01-30T20:20:00.912ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2257dc3e-f4ab-4b05-ad2d-de7843c84649", "content-length": "26", "date": "Thu, 30 Jan 2025 20:20:00 GMT"} })
37922025-01-30T20:20:00.912ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37932025-01-30T20:20:00.913ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37942025-01-30T20:20:00.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37952025-01-30T20:20:00.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37962025-01-30T20:20:00.927ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
37972025-01-30T20:20:00.927ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37982025-01-30T20:20:00.927ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8468b7e-e5df-4f8c-a444-7f4d0daddc59", "content-length": "26", "date": "Thu, 30 Jan 2025 20:20:00 GMT"} })
37992025-01-30T20:20:00.927ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38002025-01-30T20:20:00.928ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
38012025-01-30T20:20:00.929ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38022025-01-30T20:20:00.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38032025-01-30T20:20:00.931ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.028289ms iteration = 8 status = {"physical_disks_added":0}
38042025-01-30T20:20:00.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38052025-01-30T20:20:00.933ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38062025-01-30T20:20:00.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38072025-01-30T20:20:00.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38082025-01-30T20:20:00.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38092025-01-30T20:20:00.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38102025-01-30T20:20:00.936ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38112025-01-30T20:20:00.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38122025-01-30T20:20:00.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38132025-01-30T20:20:00.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38142025-01-30T20:20:00.938ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38152025-01-30T20:20:00.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38162025-01-30T20:20:00.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 172.292662ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
38172025-01-30T20:20:01.078ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38182025-01-30T20:20:01.078ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6f3bb03-7e75-429b-b210-7d17edb90f25", "content-length": "691", "date": "Thu, 30 Jan 2025 20:20:01 GMT"} })
38192025-01-30T20:20:01.078ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
38202025-01-30T20:20:01.079ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
38212025-01-30T20:20:01.079ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
38222025-01-30T20:20:01.080ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 278.906601ms iteration = 6 status = {}
38232025-01-30T20:20:01.109ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38242025-01-30T20:20:01.109ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38252025-01-30T20:20:01.110ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "34cfd4a5-313c-4969-9b09-98262d787d87", "content-length": "372", "date": "Thu, 30 Jan 2025 20:20:01 GMT"} })
38262025-01-30T20:20:01.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38272025-01-30T20:20:01.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38282025-01-30T20:20:01.124ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
38292025-01-30T20:20:01.124ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38302025-01-30T20:20:01.125ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "31156b9d-3796-4124-8886-6580de315600", "date": "Thu, 30 Jan 2025 20:20:01 GMT"} })
38312025-01-30T20:20:01.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38322025-01-30T20:20:01.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38332025-01-30T20:20:01.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38342025-01-30T20:20:01.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38352025-01-30T20:20:01.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38362025-01-30T20:20:01.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38372025-01-30T20:20:01.133ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38382025-01-30T20:20:01.133ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38392025-01-30T20:20:01.134ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3320b2bb-f32b-4562-aa95-b71630d3fd24", "date": "Thu, 30 Jan 2025 20:20:01 GMT"} })
38402025-01-30T20:20:01.135ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 334.215796ms iteration = 6 status = {}
38412025-01-30T20:20:01.153ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38422025-01-30T20:20:01.154ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c9fa14f-0e39-4aa4-a7b5-71af41fbc695", "content-length": "1", "date": "Thu, 30 Jan 2025 20:20:00 GMT"} })
38432025-01-30T20:20:01.155ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38442025-01-30T20:20:01.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38452025-01-30T20:20:01.158ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 357.116272ms iteration = 6 status = null
38462025-01-30T20:20:01.162ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 360.985349ms iteration = 6 status = {}
38472025-01-30T20:20:01.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38482025-01-30T20:20:01.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38492025-01-30T20:20:01.218ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
38502025-01-30T20:20:01.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38512025-01-30T20:20:01.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38522025-01-30T20:20:01.232ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38532025-01-30T20:20:01.233ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b1ee8cd-3d60-41ac-97ea-05d24d9617f8", "content-length": "134", "date": "Thu, 30 Jan 2025 20:20:00 GMT"} })
38542025-01-30T20:20:01.233ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
38552025-01-30T20:20:01.233ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
38562025-01-30T20:20:01.233ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38572025-01-30T20:20:01.233ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38582025-01-30T20:20:01.233ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38592025-01-30T20:20:01.233ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38602025-01-30T20:20:01.233ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38612025-01-30T20:20:01.233ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38622025-01-30T20:20:01.233ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38632025-01-30T20:20:01.233ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38642025-01-30T20:20:01.233ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
38652025-01-30T20:20:01.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38662025-01-30T20:20:01.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38672025-01-30T20:20:01.236ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38682025-01-30T20:20:01.236ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e236fff-4568-4650-a5c7-811c1f72344c", "content-length": "2", "date": "Thu, 30 Jan 2025 20:20:00 GMT"} })
38692025-01-30T20:20:01.236ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38702025-01-30T20:20:01.236ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a29cfbf9-2ae7-494c-a5ad-cdd24fbb5bc8", "content-length": "52", "date": "Thu, 30 Jan 2025 20:20:00 GMT"} })
38712025-01-30T20:20:01.236ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
38722025-01-30T20:20:01.236ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38732025-01-30T20:20:01.365ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "998c9c1c-ab4b-4d54-88df-2692fc0cc51e", "date": "Thu, 30 Jan 2025 20:20:01 GMT"} })
38742025-01-30T20:20:01.365ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
38752025-01-30T20:20:01.365ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38762025-01-30T20:20:01.365ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b47b552-8124-4344-906a-febcbdcbb23c", "content-length": "682", "date": "Thu, 30 Jan 2025 20:20:01 GMT"} })
38772025-01-30T20:20:01.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38782025-01-30T20:20:01.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38792025-01-30T20:20:01.370ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38802025-01-30T20:20:01.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38812025-01-30T20:20:01.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38822025-01-30T20:20:01.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38832025-01-30T20:20:01.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38842025-01-30T20:20:01.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38852025-01-30T20:20:01.383ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 582.092576ms iteration = 6 status = {}
38862025-01-30T20:20:01.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dd3709d1-73d3-420e-95ff-1f41e7f6d582 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
38872025-01-30T20:20:01.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dd3709d1-73d3-420e-95ff-1f41e7f6d582 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
38882025-01-30T20:20:01.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1756 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dd3709d1-73d3-420e-95ff-1f41e7f6d582 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
38892025-01-30T20:20:02.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 5705fe8e-f755-4cab-925c-31c0db7cd05d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
38902025-01-30T20:20:02.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 5705fe8e-f755-4cab-925c-31c0db7cd05d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
38912025-01-30T20:20:02.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 5705fe8e-f755-4cab-925c-31c0db7cd05d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
38922025-01-30T20:20:02.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 552 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = ff9a99fd-7dd1-4796-8974-4e9911adef2b response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
38932025-01-30T20:20:02.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 47bf64d2-c120-4e20-8a21-ba9e262c9804 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
38942025-01-30T20:20:02.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 47bf64d2-c120-4e20-8a21-ba9e262c9804 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
38952025-01-30T20:20:02.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 47bf64d2-c120-4e20-8a21-ba9e262c9804 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
38962025-01-30T20:20:03.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8a71f11c-e732-436a-95fd-abb8a37f2412 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
38972025-01-30T20:20:03.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8a71f11c-e732-436a-95fd-abb8a37f2412 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
38982025-01-30T20:20:03.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8a71f11c-e732-436a-95fd-abb8a37f2412 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
38992025-01-30T20:20:04.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a6eee767-bfd9-4ffc-8b79-7feb2095ab89 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39002025-01-30T20:20:04.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a6eee767-bfd9-4ffc-8b79-7feb2095ab89 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39012025-01-30T20:20:04.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a6eee767-bfd9-4ffc-8b79-7feb2095ab89 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39022025-01-30T20:20:05.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 143554d6-7bb4-4a95-8a11-0c4d6e228f30 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39032025-01-30T20:20:05.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 143554d6-7bb4-4a95-8a11-0c4d6e228f30 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39042025-01-30T20:20:05.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 143554d6-7bb4-4a95-8a11-0c4d6e228f30 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39052025-01-30T20:20:06.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f62c5008-5d86-4a5d-8047-c6f540289fe8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39062025-01-30T20:20:06.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f62c5008-5d86-4a5d-8047-c6f540289fe8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39072025-01-30T20:20:06.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f62c5008-5d86-4a5d-8047-c6f540289fe8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39082025-01-30T20:20:07.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9dc02d55-40d9-4fd4-b721-33d29348736c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39092025-01-30T20:20:07.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9dc02d55-40d9-4fd4-b721-33d29348736c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39102025-01-30T20:20:07.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9dc02d55-40d9-4fd4-b721-33d29348736c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39112025-01-30T20:20:08.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4923d674-6628-4c78-9915-0de2bafd8734 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39122025-01-30T20:20:08.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4923d674-6628-4c78-9915-0de2bafd8734 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39132025-01-30T20:20:08.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4923d674-6628-4c78-9915-0de2bafd8734 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39142025-01-30T20:20:10.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d955c49b-1934-44a6-a6ac-79643c88079a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39152025-01-30T20:20:10.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d955c49b-1934-44a6-a6ac-79643c88079a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39162025-01-30T20:20:10.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d955c49b-1934-44a6-a6ac-79643c88079a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39172025-01-30T20:20:10.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
39182025-01-30T20:20:10.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
39192025-01-30T20:20:10.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39202025-01-30T20:20:10.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39212025-01-30T20:20:10.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39222025-01-30T20:20:10.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39232025-01-30T20:20:10.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39242025-01-30T20:20:10.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39252025-01-30T20:20:10.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39262025-01-30T20:20:10.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.814504ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39272025-01-30T20:20:10.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39282025-01-30T20:20:10.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39292025-01-30T20:20:10.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39302025-01-30T20:20:10.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39312025-01-30T20:20:10.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39322025-01-30T20:20:10.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39332025-01-30T20:20:10.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
39342025-01-30T20:20:10.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39352025-01-30T20:20:10.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39362025-01-30T20:20:10.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
39372025-01-30T20:20:10.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.794689ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
39382025-01-30T20:20:11.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7b4f7a2-31b8-42d6-bdef-a07bda742ca2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39392025-01-30T20:20:11.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7b4f7a2-31b8-42d6-bdef-a07bda742ca2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39402025-01-30T20:20:11.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7b4f7a2-31b8-42d6-bdef-a07bda742ca2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39412025-01-30T20:20:12.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0877f353-befb-4162-8042-885c1001e947 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39422025-01-30T20:20:12.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0877f353-befb-4162-8042-885c1001e947 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39432025-01-30T20:20:12.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0877f353-befb-4162-8042-885c1001e947 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39442025-01-30T20:20:12.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 644 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 9e1b8178-0753-4c75-af4b-954240854a90 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
39452025-01-30T20:20:13.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d8155492-fa62-44ab-86a5-ace16e91e5c6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39462025-01-30T20:20:13.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d8155492-fa62-44ab-86a5-ace16e91e5c6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39472025-01-30T20:20:13.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d8155492-fa62-44ab-86a5-ace16e91e5c6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39482025-01-30T20:20:14.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4236c718-cece-41ff-a6d8-3e47a418dd03 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39492025-01-30T20:20:14.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4236c718-cece-41ff-a6d8-3e47a418dd03 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39502025-01-30T20:20:14.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4236c718-cece-41ff-a6d8-3e47a418dd03 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39512025-01-30T20:20:15.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9a20341b-f248-4035-bbf3-f1b9f6bfa850 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39522025-01-30T20:20:15.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9a20341b-f248-4035-bbf3-f1b9f6bfa850 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39532025-01-30T20:20:15.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9a20341b-f248-4035-bbf3-f1b9f6bfa850 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39542025-01-30T20:20:16.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bc9d16de-62d2-41c6-8335-37c15f2bfbe3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39552025-01-30T20:20:16.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bc9d16de-62d2-41c6-8335-37c15f2bfbe3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39562025-01-30T20:20:16.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bc9d16de-62d2-41c6-8335-37c15f2bfbe3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39572025-01-30T20:20:17.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd4a152c-28d1-43af-89dd-981bc275ca19 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39582025-01-30T20:20:17.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd4a152c-28d1-43af-89dd-981bc275ca19 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39592025-01-30T20:20:17.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd4a152c-28d1-43af-89dd-981bc275ca19 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39602025-01-30T20:20:18.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0b02373a-ba69-4874-a5f3-e8a9d884edeb roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39612025-01-30T20:20:18.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0b02373a-ba69-4874-a5f3-e8a9d884edeb resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39622025-01-30T20:20:18.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0b02373a-ba69-4874-a5f3-e8a9d884edeb response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39632025-01-30T20:20:19.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 492abe24-bc6b-4272-a443-85668ed3730d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39642025-01-30T20:20:19.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 492abe24-bc6b-4272-a443-85668ed3730d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39652025-01-30T20:20:19.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 492abe24-bc6b-4272-a443-85668ed3730d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39662025-01-30T20:20:20.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c37f9d9b-d4cd-4ec2-a67c-ef074ca12d9d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39672025-01-30T20:20:20.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c37f9d9b-d4cd-4ec2-a67c-ef074ca12d9d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39682025-01-30T20:20:20.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c37f9d9b-d4cd-4ec2-a67c-ef074ca12d9d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39692025-01-30T20:20:20.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
39702025-01-30T20:20:20.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
39712025-01-30T20:20:20.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39722025-01-30T20:20:20.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39732025-01-30T20:20:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39742025-01-30T20:20:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39752025-01-30T20:20:20.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39762025-01-30T20:20:20.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39772025-01-30T20:20:20.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39782025-01-30T20:20:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39792025-01-30T20:20:20.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39802025-01-30T20:20:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39812025-01-30T20:20:20.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39822025-01-30T20:20:20.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39832025-01-30T20:20:20.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39842025-01-30T20:20:20.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
39852025-01-30T20:20:20.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39862025-01-30T20:20:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39872025-01-30T20:20:20.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
39882025-01-30T20:20:20.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.423601ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
39892025-01-30T20:20:20.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.106326ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39902025-01-30T20:20:21.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 98856638-ba70-4d48-89f8-2538d1c37a9d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39912025-01-30T20:20:21.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 98856638-ba70-4d48-89f8-2538d1c37a9d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39922025-01-30T20:20:21.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 98856638-ba70-4d48-89f8-2538d1c37a9d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39932025-01-30T20:20:22.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c495d096-70c6-44a5-8ab9-ba469d1f0412 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39942025-01-30T20:20:22.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c495d096-70c6-44a5-8ab9-ba469d1f0412 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39952025-01-30T20:20:22.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c495d096-70c6-44a5-8ab9-ba469d1f0412 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39962025-01-30T20:20:22.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 619 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = bd06c350-02b0-427f-9630-e21d264beba2 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
39972025-01-30T20:20:23.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 50d4aa0e-dcac-45dc-9b00-4d23025ca4de roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39982025-01-30T20:20:23.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 50d4aa0e-dcac-45dc-9b00-4d23025ca4de resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
39992025-01-30T20:20:23.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 50d4aa0e-dcac-45dc-9b00-4d23025ca4de response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40002025-01-30T20:20:24.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6319bb5f-f663-4ddc-9c96-81d26847e70a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40012025-01-30T20:20:24.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6319bb5f-f663-4ddc-9c96-81d26847e70a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40022025-01-30T20:20:24.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6319bb5f-f663-4ddc-9c96-81d26847e70a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40032025-01-30T20:20:25.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 463676d2-f9bb-4a89-8b5a-b7e4c41e5f74 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40042025-01-30T20:20:25.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 463676d2-f9bb-4a89-8b5a-b7e4c41e5f74 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40052025-01-30T20:20:25.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 463676d2-f9bb-4a89-8b5a-b7e4c41e5f74 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40062025-01-30T20:20:26.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dd427dde-8339-4625-b8e4-959ac07ace2b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40072025-01-30T20:20:26.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dd427dde-8339-4625-b8e4-959ac07ace2b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40082025-01-30T20:20:26.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dd427dde-8339-4625-b8e4-959ac07ace2b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40092025-01-30T20:20:27.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8b8eaa70-3b9a-4812-8afa-191eba9b0b3a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40102025-01-30T20:20:27.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8b8eaa70-3b9a-4812-8afa-191eba9b0b3a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40112025-01-30T20:20:27.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8b8eaa70-3b9a-4812-8afa-191eba9b0b3a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40122025-01-30T20:20:28.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd7093cf-af94-45aa-aa0c-6f15e1db4231 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40132025-01-30T20:20:28.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd7093cf-af94-45aa-aa0c-6f15e1db4231 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40142025-01-30T20:20:28.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd7093cf-af94-45aa-aa0c-6f15e1db4231 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40152025-01-30T20:20:29.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = de615881-7716-4c6e-a028-8bb03a6c683b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40162025-01-30T20:20:29.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = de615881-7716-4c6e-a028-8bb03a6c683b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40172025-01-30T20:20:29.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = de615881-7716-4c6e-a028-8bb03a6c683b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40182025-01-30T20:20:30.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b2337985-cf6a-4fe3-a2c3-f14daa90aee2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40192025-01-30T20:20:30.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b2337985-cf6a-4fe3-a2c3-f14daa90aee2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40202025-01-30T20:20:30.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b2337985-cf6a-4fe3-a2c3-f14daa90aee2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
40212025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
40222025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
40232025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40242025-01-30T20:20:30.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:10:30.801302903 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
40252025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
40262025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
40272025-01-30T20:20:30.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
40282025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.231\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
40292025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
40302025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
40312025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
40322025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40332025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40342025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
40352025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40362025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40372025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
40382025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40392025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
40402025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40412025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
40422025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40432025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
40442025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
40452025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40462025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
40472025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40482025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
40492025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40502025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
40512025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
40522025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40532025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 7 reason = Timeout
40542025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
40552025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40562025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
40572025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40582025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
40592025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
40602025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40612025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
40622025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40632025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
40642025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40652025-01-30T20:20:30.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
40662025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
40672025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
40682025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40692025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
40702025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40712025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
40722025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40732025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
40742025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
40752025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40762025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
40772025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
40782025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40792025-01-30T20:20:30.802ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40802025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
40812025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
40822025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40832025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
40842025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
40852025-01-30T20:20:30.802ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
40862025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40872025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40882025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
40892025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40902025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40912025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40922025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40932025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40942025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40952025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40962025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40972025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40982025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40992025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41002025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41012025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41022025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41032025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41042025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41052025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41062025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41072025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41082025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41092025-01-30T20:20:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2382, tv_nsec: 12448213 } })
41102025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41112025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41122025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
41132025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41142025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41152025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41162025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41172025-01-30T20:20:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2382, tv_nsec: 12511254 } })
41182025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41192025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41202025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41212025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41222025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
41232025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.10263ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
41242025-01-30T20:20:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41252025-01-30T20:20:30.803ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
41262025-01-30T20:20:30.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.402699ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
41272025-01-30T20:20:30.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41282025-01-30T20:20:30.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41292025-01-30T20:20:30.805ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:10:30.801302903 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
41302025-01-30T20:20:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.930899ms iteration = 4 status = {"expiration":"2025-01-30T20:10:30.801302903Z","pruned":[]}
41312025-01-30T20:20:30.805ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41322025-01-30T20:20:30.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41332025-01-30T20:20:30.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.624968ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41342025-01-30T20:20:30.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41352025-01-30T20:20:30.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2382, tv_nsec: 17630847 } })
41362025-01-30T20:20:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41372025-01-30T20:20:30.807ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41382025-01-30T20:20:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41392025-01-30T20:20:30.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
41402025-01-30T20:20:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41412025-01-30T20:20:30.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41422025-01-30T20:20:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41432025-01-30T20:20:30.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41442025-01-30T20:20:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41452025-01-30T20:20:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41462025-01-30T20:20:30.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41472025-01-30T20:20:30.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41482025-01-30T20:20:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41492025-01-30T20:20:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41502025-01-30T20:20:30.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41512025-01-30T20:20:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41522025-01-30T20:20:30.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41532025-01-30T20:20:30.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2382, tv_nsec: 22378508 } })
41542025-01-30T20:20:30.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
41552025-01-30T20:20:30.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41562025-01-30T20:20:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41572025-01-30T20:20:30.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41582025-01-30T20:20:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41592025-01-30T20:20:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41602025-01-30T20:20:30.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41612025-01-30T20:20:30.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41622025-01-30T20:20:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41632025-01-30T20:20:30.816ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41642025-01-30T20:20:30.816ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41652025-01-30T20:20:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41662025-01-30T20:20:30.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41672025-01-30T20:20:30.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41682025-01-30T20:20:30.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41692025-01-30T20:20:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41702025-01-30T20:20:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41712025-01-30T20:20:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
41722025-01-30T20:20:30.820ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41732025-01-30T20:20:30.820ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.646818ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
41742025-01-30T20:20:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41752025-01-30T20:20:30.821ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41762025-01-30T20:20:30.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41772025-01-30T20:20:30.826ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41782025-01-30T20:20:30.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41792025-01-30T20:20:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41802025-01-30T20:20:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
41812025-01-30T20:20:30.827ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41822025-01-30T20:20:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41832025-01-30T20:20:30.828ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41842025-01-30T20:20:30.829ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.438082ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
41852025-01-30T20:20:30.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41862025-01-30T20:20:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41872025-01-30T20:20:30.830ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41882025-01-30T20:20:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41892025-01-30T20:20:30.830ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41902025-01-30T20:20:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41912025-01-30T20:20:30.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41922025-01-30T20:20:30.832ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41932025-01-30T20:20:30.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41942025-01-30T20:20:30.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.922284ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41952025-01-30T20:20:30.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41962025-01-30T20:20:30.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41972025-01-30T20:20:30.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41982025-01-30T20:20:30.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41992025-01-30T20:20:30.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42002025-01-30T20:20:30.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42012025-01-30T20:20:30.858ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42022025-01-30T20:20:30.858ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42032025-01-30T20:20:30.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42042025-01-30T20:20:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42052025-01-30T20:20:30.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42062025-01-30T20:20:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42072025-01-30T20:20:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42082025-01-30T20:20:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42092025-01-30T20:20:30.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.920978ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
42102025-01-30T20:20:30.865ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
42112025-01-30T20:20:30.865ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
42122025-01-30T20:20:30.865ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.304977ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
42132025-01-30T20:20:30.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42142025-01-30T20:20:30.874ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42152025-01-30T20:20:30.874ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.824292ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42162025-01-30T20:20:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42172025-01-30T20:20:30.876ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
42182025-01-30T20:20:30.876ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
42192025-01-30T20:20:30.876ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
42202025-01-30T20:20:30.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42212025-01-30T20:20:30.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42222025-01-30T20:20:30.886ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42232025-01-30T20:20:30.886ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42242025-01-30T20:20:30.886ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42252025-01-30T20:20:30.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42262025-01-30T20:20:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42272025-01-30T20:20:30.931ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
42282025-01-30T20:20:30.950ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
42292025-01-30T20:20:30.950ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42302025-01-30T20:20:30.950ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e26ddbe-6634-4ff6-9823-c07245c43342", "content-length": "26", "date": "Thu, 30 Jan 2025 20:20:30 GMT"} })
42312025-01-30T20:20:30.950ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42322025-01-30T20:20:30.951ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42332025-01-30T20:20:30.952ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
42342025-01-30T20:20:30.952ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42352025-01-30T20:20:30.952ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "16bf8e85-d0cf-4d55-9b9e-8aca860de82e", "content-length": "26", "date": "Thu, 30 Jan 2025 20:20:30 GMT"} })
42362025-01-30T20:20:30.952ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42372025-01-30T20:20:30.953ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42382025-01-30T20:20:31.045ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42392025-01-30T20:20:31.063ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
42402025-01-30T20:20:31.113ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 312.148054ms iteration = 7 status = {}
42412025-01-30T20:20:31.115ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
42422025-01-30T20:20:31.115ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5d1bb25-429d-4ae2-9613-97387a9fa472", "content-length": "1", "date": "Thu, 30 Jan 2025 20:20:30 GMT"} })
42432025-01-30T20:20:31.117ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42442025-01-30T20:20:31.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42452025-01-30T20:20:31.119ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
42462025-01-30T20:20:31.119ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42472025-01-30T20:20:31.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42482025-01-30T20:20:31.121ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42492025-01-30T20:20:31.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42502025-01-30T20:20:31.122ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42512025-01-30T20:20:31.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42522025-01-30T20:20:31.123ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42532025-01-30T20:20:31.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42542025-01-30T20:20:31.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42552025-01-30T20:20:31.127ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a60b6602-f808-4912-8f70-12399cd18bd8", "content-length": "64", "date": "Thu, 30 Jan 2025 20:20:31 GMT"} })
42562025-01-30T20:20:31.127ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42572025-01-30T20:20:31.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42582025-01-30T20:20:31.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42592025-01-30T20:20:31.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42602025-01-30T20:20:31.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42612025-01-30T20:20:31.128ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2382, tv_nsec: 338549263 } })
42622025-01-30T20:20:31.128ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
42632025-01-30T20:20:31.135ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42642025-01-30T20:20:31.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42652025-01-30T20:20:31.138ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 336.647614ms iteration = 7 status = null
42662025-01-30T20:20:31.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42672025-01-30T20:20:31.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42682025-01-30T20:20:31.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42692025-01-30T20:20:31.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42702025-01-30T20:20:31.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42712025-01-30T20:20:31.191ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 389.50077ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42722025-01-30T20:20:31.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42732025-01-30T20:20:31.193ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42742025-01-30T20:20:31.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42752025-01-30T20:20:31.193ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 392.227016ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42762025-01-30T20:20:31.193ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42772025-01-30T20:20:31.193ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
42782025-01-30T20:20:31.193ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42792025-01-30T20:20:31.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42802025-01-30T20:20:31.197ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42812025-01-30T20:20:31.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42822025-01-30T20:20:31.197ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42832025-01-30T20:20:31.197ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
42842025-01-30T20:20:31.197ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 396.013251ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
42852025-01-30T20:20:31.198ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42862025-01-30T20:20:31.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42872025-01-30T20:20:31.198ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3e1a58d9-e7ee-4a85-9d88-308d106fb797", "date": "Thu, 30 Jan 2025 20:20:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42882025-01-30T20:20:31.198ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42892025-01-30T20:20:31.199ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42902025-01-30T20:20:31.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42912025-01-30T20:20:31.200ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c32a4090-8937-4ba2-9d7f-f9fb33187e9d", "date": "Thu, 30 Jan 2025 20:20:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42922025-01-30T20:20:31.200ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
42932025-01-30T20:20:31.200ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42942025-01-30T20:20:31.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42952025-01-30T20:20:31.201ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42962025-01-30T20:20:31.201ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42972025-01-30T20:20:31.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42982025-01-30T20:20:31.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42992025-01-30T20:20:31.202ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8e9666ad-448c-49c2-b5b4-7369f46f05e1", "date": "Thu, 30 Jan 2025 20:20:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
43002025-01-30T20:20:31.202ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
43012025-01-30T20:20:31.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
43022025-01-30T20:20:31.203ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43032025-01-30T20:20:31.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43042025-01-30T20:20:31.203ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43052025-01-30T20:20:31.205ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
43062025-01-30T20:20:31.205ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 403.975712ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43072025-01-30T20:20:31.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43082025-01-30T20:20:31.207ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43092025-01-30T20:20:31.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43102025-01-30T20:20:31.212ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43112025-01-30T20:20:31.212ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "fc32818f-a276-42d5-b2ee-54750d34f72d", "date": "Thu, 30 Jan 2025 20:20:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43122025-01-30T20:20:31.212ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43132025-01-30T20:20:31.213ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43142025-01-30T20:20:31.214ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4855b0c6-8ee9-450d-9767-03b0218829e4", "date": "Thu, 30 Jan 2025 20:20:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43152025-01-30T20:20:31.214ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43162025-01-30T20:20:31.215ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
43172025-01-30T20:20:31.215ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43182025-01-30T20:20:31.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43192025-01-30T20:20:31.215ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43202025-01-30T20:20:31.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43212025-01-30T20:20:31.215ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "17055c5e-f3f2-4fc6-bfe3-4c03b686e2f7", "content-length": "26", "date": "Thu, 30 Jan 2025 20:20:30 GMT"} })
43222025-01-30T20:20:31.215ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43232025-01-30T20:20:31.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43242025-01-30T20:20:31.216ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43252025-01-30T20:20:31.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 414.867434ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
43262025-01-30T20:20:31.216ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
43272025-01-30T20:20:31.217ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43282025-01-30T20:20:31.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43292025-01-30T20:20:31.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
43302025-01-30T20:20:31.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43312025-01-30T20:20:31.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43322025-01-30T20:20:31.220ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43332025-01-30T20:20:31.221ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
43342025-01-30T20:20:31.221ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
43352025-01-30T20:20:31.221ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43362025-01-30T20:20:31.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43372025-01-30T20:20:31.222ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 420.8351ms iteration = 3 status = {"nsuccess":5}
43382025-01-30T20:20:31.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43392025-01-30T20:20:31.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
43402025-01-30T20:20:31.223ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43412025-01-30T20:20:31.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43422025-01-30T20:20:31.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43432025-01-30T20:20:31.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43442025-01-30T20:20:31.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43452025-01-30T20:20:31.232ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
43462025-01-30T20:20:31.232ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
43472025-01-30T20:20:31.232ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-30 20:18:12.536035 UTC dns_group = internal generation = 1
43482025-01-30T20:20:31.233ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 431.390043ms iteration = 4 status = {"generation":1}
43492025-01-30T20:20:31.238ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43502025-01-30T20:20:31.238ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43512025-01-30T20:20:31.239ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 437.572174ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43522025-01-30T20:20:31.243ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
43532025-01-30T20:20:31.243ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 441.590446ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
43542025-01-30T20:20:31.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43552025-01-30T20:20:31.249ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
43562025-01-30T20:20:31.249ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
43572025-01-30T20:20:31.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43582025-01-30T20:20:31.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43592025-01-30T20:20:31.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43602025-01-30T20:20:31.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
43612025-01-30T20:20:31.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43622025-01-30T20:20:31.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43632025-01-30T20:20:31.253ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
43642025-01-30T20:20:31.253ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 451.757189ms iteration = 7 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
43652025-01-30T20:20:31.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43662025-01-30T20:20:31.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43672025-01-30T20:20:31.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43682025-01-30T20:20:31.259ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 457.477488ms iteration = 7 status = 0
43692025-01-30T20:20:31.264ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
43702025-01-30T20:20:31.264ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43712025-01-30T20:20:31.264ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-30 20:18:13.133071 UTC dns_group = external generation = 2
43722025-01-30T20:20:31.264ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 463.147985ms iteration = 4 status = {"generation":2}
43732025-01-30T20:20:31.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 467.707611ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
43742025-01-30T20:20:31.274ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
43752025-01-30T20:20:31.274ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 473.269225ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
43762025-01-30T20:20:31.284ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43772025-01-30T20:20:31.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43782025-01-30T20:20:31.294ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43792025-01-30T20:20:31.297ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43802025-01-30T20:20:31.297ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43812025-01-30T20:20:31.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43822025-01-30T20:20:31.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43832025-01-30T20:20:31.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43842025-01-30T20:20:31.299ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43852025-01-30T20:20:31.301ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43862025-01-30T20:20:31.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43872025-01-30T20:20:31.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43882025-01-30T20:20:31.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43892025-01-30T20:20:31.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43902025-01-30T20:20:31.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43912025-01-30T20:20:31.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43922025-01-30T20:20:31.338ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) }
43932025-01-30T20:20:31.338ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 536.384237ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43942025-01-30T20:20:31.360ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43952025-01-30T20:20:31.360ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43962025-01-30T20:20:31.360ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "09c5b96f-adb2-4088-be1a-a9dd39683ce7", "content-length": "372", "date": "Thu, 30 Jan 2025 20:20:31 GMT"} })
43972025-01-30T20:20:31.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43982025-01-30T20:20:31.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43992025-01-30T20:20:31.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44002025-01-30T20:20:31.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44012025-01-30T20:20:31.366ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
44022025-01-30T20:20:31.366ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44032025-01-30T20:20:31.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44042025-01-30T20:20:31.373ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 571.851002ms iteration = 9 status = {"physical_disks_added":0}
44052025-01-30T20:20:31.378ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44062025-01-30T20:20:31.379ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "10f313f0-7eda-4799-9b65-6a3758d078b0", "content-length": "134", "date": "Thu, 30 Jan 2025 20:20:30 GMT"} })
44072025-01-30T20:20:31.379ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44082025-01-30T20:20:31.379ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
44092025-01-30T20:20:31.379ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44102025-01-30T20:20:31.379ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44112025-01-30T20:20:31.379ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44122025-01-30T20:20:31.379ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44132025-01-30T20:20:31.379ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44142025-01-30T20:20:31.379ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44152025-01-30T20:20:31.379ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44162025-01-30T20:20:31.379ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44172025-01-30T20:20:31.379ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
44182025-01-30T20:20:31.379ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44192025-01-30T20:20:31.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44202025-01-30T20:20:31.382ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44212025-01-30T20:20:31.382ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2921df6-10da-41db-834f-0f939e0f68f2", "content-length": "2", "date": "Thu, 30 Jan 2025 20:20:30 GMT"} })
44222025-01-30T20:20:31.382ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44232025-01-30T20:20:31.383ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "23eec2a4-0fa1-46c8-b856-4714f672d635", "content-length": "52", "date": "Thu, 30 Jan 2025 20:20:30 GMT"} })
44242025-01-30T20:20:31.383ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
44252025-01-30T20:20:31.383ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44262025-01-30T20:20:31.409ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
44272025-01-30T20:20:31.409ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44282025-01-30T20:20:31.472ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44292025-01-30T20:20:31.536ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "63013057-65a2-4a5a-a77a-cc9cf3356895", "date": "Thu, 30 Jan 2025 20:20:31 GMT"} })
44302025-01-30T20:20:31.536ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
44312025-01-30T20:20:31.536ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44322025-01-30T20:20:31.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7c5fa817-d481-4ed8-b64f-9149100199ad roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44332025-01-30T20:20:31.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7c5fa817-d481-4ed8-b64f-9149100199ad resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44342025-01-30T20:20:31.537ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bf2b5050-0bda-4de8-a5bc-e09821a47a09", "date": "Thu, 30 Jan 2025 20:20:31 GMT"} })
44352025-01-30T20:20:31.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44362025-01-30T20:20:31.537ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "eadb667c-54d5-4285-be7a-22690d255c25", "content-length": "682", "date": "Thu, 30 Jan 2025 20:20:31 GMT"} })
44372025-01-30T20:20:31.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44382025-01-30T20:20:31.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44392025-01-30T20:20:31.538ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "11fc8795-acca-4607-9343-630baf17f457", "content-length": "691", "date": "Thu, 30 Jan 2025 20:20:31 GMT"} })
44402025-01-30T20:20:31.538ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
44412025-01-30T20:20:31.538ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
44422025-01-30T20:20:31.538ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
44432025-01-30T20:20:31.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44442025-01-30T20:20:31.539ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 738.310681ms iteration = 7 status = {}
44452025-01-30T20:20:31.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7c5fa817-d481-4ed8-b64f-9149100199ad response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44462025-01-30T20:20:31.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44472025-01-30T20:20:31.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44482025-01-30T20:20:31.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44492025-01-30T20:20:31.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44502025-01-30T20:20:31.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44512025-01-30T20:20:31.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44522025-01-30T20:20:31.548ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44532025-01-30T20:20:31.548ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44542025-01-30T20:20:31.549ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7f1b0574-21b6-41db-9c40-e48269d554f0", "date": "Thu, 30 Jan 2025 20:20:31 GMT"} })
44552025-01-30T20:20:31.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44562025-01-30T20:20:31.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44572025-01-30T20:20:31.551ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 749.539863ms iteration = 7 status = {}
44582025-01-30T20:20:31.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44592025-01-30T20:20:31.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44602025-01-30T20:20:31.558ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 757.280758ms iteration = 7 status = {}
44612025-01-30T20:20:32.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 5ecef7aa-b83b-4e4a-859f-da393a5e7f16 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
44622025-01-30T20:20:32.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 5ecef7aa-b83b-4e4a-859f-da393a5e7f16 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
44632025-01-30T20:20:32.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 5ecef7aa-b83b-4e4a-859f-da393a5e7f16 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
44642025-01-30T20:20:32.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 585 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 19c08cba-d669-42c0-8585-3df3beceb335 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
44652025-01-30T20:20:32.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 53427980-df30-44ff-bfac-a96ddd28e3d2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44662025-01-30T20:20:32.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 53427980-df30-44ff-bfac-a96ddd28e3d2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44672025-01-30T20:20:32.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 53427980-df30-44ff-bfac-a96ddd28e3d2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44682025-01-30T20:20:33.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 90d6ee43-fb4d-48be-8853-e61c3d46f8ff roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44692025-01-30T20:20:33.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 90d6ee43-fb4d-48be-8853-e61c3d46f8ff resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44702025-01-30T20:20:33.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 90d6ee43-fb4d-48be-8853-e61c3d46f8ff response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44712025-01-30T20:20:34.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8e850664-76b9-4938-ac66-2d5dd707ba52 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44722025-01-30T20:20:34.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8e850664-76b9-4938-ac66-2d5dd707ba52 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44732025-01-30T20:20:34.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8e850664-76b9-4938-ac66-2d5dd707ba52 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44742025-01-30T20:20:35.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 43f94fbd-6f26-44a8-9793-eadfb989a93f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44752025-01-30T20:20:35.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 43f94fbd-6f26-44a8-9793-eadfb989a93f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44762025-01-30T20:20:35.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 43f94fbd-6f26-44a8-9793-eadfb989a93f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44772025-01-30T20:20:36.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4255683c-bf0e-45d5-bf86-c16b57acfb70 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44782025-01-30T20:20:36.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4255683c-bf0e-45d5-bf86-c16b57acfb70 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44792025-01-30T20:20:36.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4255683c-bf0e-45d5-bf86-c16b57acfb70 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44802025-01-30T20:20:37.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 73bba5fc-13c2-4e1d-b607-62518876ef98 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44812025-01-30T20:20:37.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 73bba5fc-13c2-4e1d-b607-62518876ef98 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44822025-01-30T20:20:37.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 73bba5fc-13c2-4e1d-b607-62518876ef98 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44832025-01-30T20:20:38.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 11318596-c8f1-4ecc-81e6-2b00c3ad12a9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44842025-01-30T20:20:38.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 11318596-c8f1-4ecc-81e6-2b00c3ad12a9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44852025-01-30T20:20:38.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 11318596-c8f1-4ecc-81e6-2b00c3ad12a9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44862025-01-30T20:20:39.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 04813094-6f02-4935-9d2a-2c08b4d49b97 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44872025-01-30T20:20:39.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 04813094-6f02-4935-9d2a-2c08b4d49b97 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44882025-01-30T20:20:39.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 04813094-6f02-4935-9d2a-2c08b4d49b97 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44892025-01-30T20:20:40.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31968e07-0f73-4298-bc0b-70350a27ef9c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44902025-01-30T20:20:40.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31968e07-0f73-4298-bc0b-70350a27ef9c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44912025-01-30T20:20:40.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31968e07-0f73-4298-bc0b-70350a27ef9c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
44922025-01-30T20:20:40.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
44932025-01-30T20:20:40.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
44942025-01-30T20:20:40.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44952025-01-30T20:20:40.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44962025-01-30T20:20:40.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44972025-01-30T20:20:40.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44982025-01-30T20:20:40.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44992025-01-30T20:20:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45002025-01-30T20:20:40.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45012025-01-30T20:20:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45022025-01-30T20:20:40.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45032025-01-30T20:20:40.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45042025-01-30T20:20:40.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45052025-01-30T20:20:40.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
45062025-01-30T20:20:40.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45072025-01-30T20:20:40.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45082025-01-30T20:20:40.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
45092025-01-30T20:20:40.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.007214ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
45102025-01-30T20:20:40.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45112025-01-30T20:20:40.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45122025-01-30T20:20:40.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.924374ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45132025-01-30T20:20:41.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a88a9917-e14f-48b5-b7a3-470c713c2cae roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45142025-01-30T20:20:41.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a88a9917-e14f-48b5-b7a3-470c713c2cae resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45152025-01-30T20:20:41.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a88a9917-e14f-48b5-b7a3-470c713c2cae response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45162025-01-30T20:20:42.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 630 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 582a31de-ef7d-4354-8138-475a9690a499 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
45172025-01-30T20:20:42.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 277807da-09aa-4925-a78c-5bbd3b599f62 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45182025-01-30T20:20:42.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 277807da-09aa-4925-a78c-5bbd3b599f62 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45192025-01-30T20:20:42.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 277807da-09aa-4925-a78c-5bbd3b599f62 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45202025-01-30T20:20:43.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3f13b19b-ed5a-47ca-aca6-80e7619a356d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45212025-01-30T20:20:43.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3f13b19b-ed5a-47ca-aca6-80e7619a356d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45222025-01-30T20:20:43.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3f13b19b-ed5a-47ca-aca6-80e7619a356d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45232025-01-30T20:20:44.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 80441604-0d00-46fd-a5d3-9cb7eac55b44 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45242025-01-30T20:20:44.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 80441604-0d00-46fd-a5d3-9cb7eac55b44 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45252025-01-30T20:20:44.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 80441604-0d00-46fd-a5d3-9cb7eac55b44 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45262025-01-30T20:20:45.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 72a4a5c9-d9f3-40e9-9f20-ec2fb59da194 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45272025-01-30T20:20:45.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 72a4a5c9-d9f3-40e9-9f20-ec2fb59da194 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45282025-01-30T20:20:45.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 72a4a5c9-d9f3-40e9-9f20-ec2fb59da194 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45292025-01-30T20:20:46.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ba2e8268-b5a5-4f6e-b42e-f8df00b72aeb roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45302025-01-30T20:20:46.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ba2e8268-b5a5-4f6e-b42e-f8df00b72aeb resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45312025-01-30T20:20:46.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ba2e8268-b5a5-4f6e-b42e-f8df00b72aeb response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45322025-01-30T20:20:47.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ff256094-a036-43a1-b5dc-dc2e671d1250 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45332025-01-30T20:20:47.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ff256094-a036-43a1-b5dc-dc2e671d1250 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45342025-01-30T20:20:47.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ff256094-a036-43a1-b5dc-dc2e671d1250 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45352025-01-30T20:20:48.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d89a9058-63bf-41bf-a091-3ee33ffe21f6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45362025-01-30T20:20:48.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d89a9058-63bf-41bf-a091-3ee33ffe21f6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45372025-01-30T20:20:48.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d89a9058-63bf-41bf-a091-3ee33ffe21f6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45382025-01-30T20:20:49.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9235b34e-1b16-47c0-a22f-cb0804f0cdc6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45392025-01-30T20:20:49.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9235b34e-1b16-47c0-a22f-cb0804f0cdc6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45402025-01-30T20:20:49.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9235b34e-1b16-47c0-a22f-cb0804f0cdc6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45412025-01-30T20:20:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
45422025-01-30T20:20:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45432025-01-30T20:20:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
45442025-01-30T20:20:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45452025-01-30T20:20:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45462025-01-30T20:20:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45472025-01-30T20:20:50.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45482025-01-30T20:20:50.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45492025-01-30T20:20:50.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45502025-01-30T20:20:50.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45512025-01-30T20:20:50.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45522025-01-30T20:20:50.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45532025-01-30T20:20:50.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45542025-01-30T20:20:50.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45552025-01-30T20:20:50.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45562025-01-30T20:20:50.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
45572025-01-30T20:20:50.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45582025-01-30T20:20:50.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45592025-01-30T20:20:50.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
45602025-01-30T20:20:50.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.292064ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
45612025-01-30T20:20:50.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.261935ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45622025-01-30T20:20:50.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c03f00aa-f7be-426b-8089-ea7d0701e1cd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45632025-01-30T20:20:50.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c03f00aa-f7be-426b-8089-ea7d0701e1cd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45642025-01-30T20:20:50.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c03f00aa-f7be-426b-8089-ea7d0701e1cd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45652025-01-30T20:20:51.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 14a40fd5-880f-438b-9ba3-f87b1f3fc799 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45662025-01-30T20:20:51.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 14a40fd5-880f-438b-9ba3-f87b1f3fc799 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45672025-01-30T20:20:51.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 14a40fd5-880f-438b-9ba3-f87b1f3fc799 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45682025-01-30T20:20:52.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 575 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 32eb9a48-93ab-44ed-a241-6f4c9075b02f response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
45692025-01-30T20:20:53.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7aa32cb4-baa7-49f5-97da-93f2485d7193 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45702025-01-30T20:20:53.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7aa32cb4-baa7-49f5-97da-93f2485d7193 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45712025-01-30T20:20:53.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7aa32cb4-baa7-49f5-97da-93f2485d7193 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45722025-01-30T20:20:54.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ed0e45ca-a4c4-4e8d-9409-49a74d1f3c0c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45732025-01-30T20:20:54.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ed0e45ca-a4c4-4e8d-9409-49a74d1f3c0c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45742025-01-30T20:20:54.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ed0e45ca-a4c4-4e8d-9409-49a74d1f3c0c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45752025-01-30T20:20:55.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1ce4579f-ca35-4a42-be30-d7b324caeca6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45762025-01-30T20:20:55.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1ce4579f-ca35-4a42-be30-d7b324caeca6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45772025-01-30T20:20:55.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1ce4579f-ca35-4a42-be30-d7b324caeca6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45782025-01-30T20:20:56.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d4f93334-3e79-41b6-afac-0e7398a14b3b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45792025-01-30T20:20:56.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d4f93334-3e79-41b6-afac-0e7398a14b3b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45802025-01-30T20:20:56.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d4f93334-3e79-41b6-afac-0e7398a14b3b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45812025-01-30T20:20:57.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 225d82ae-9b66-488a-b888-261bad026042 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45822025-01-30T20:20:57.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 225d82ae-9b66-488a-b888-261bad026042 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45832025-01-30T20:20:57.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 225d82ae-9b66-488a-b888-261bad026042 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45842025-01-30T20:20:58.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4a043275-43b7-4e71-9573-2f73ba46f07c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45852025-01-30T20:20:58.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4a043275-43b7-4e71-9573-2f73ba46f07c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45862025-01-30T20:20:58.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4a043275-43b7-4e71-9573-2f73ba46f07c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45872025-01-30T20:20:59.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5443d847-1023-4b32-976b-5d9d44482cab roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45882025-01-30T20:20:59.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5443d847-1023-4b32-976b-5d9d44482cab resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45892025-01-30T20:20:59.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5443d847-1023-4b32-976b-5d9d44482cab response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45902025-01-30T20:21:00.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 93f8389b-28cb-4f39-b98e-3a50a1b73fdb roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45912025-01-30T20:21:00.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 93f8389b-28cb-4f39-b98e-3a50a1b73fdb resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45922025-01-30T20:21:00.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 93f8389b-28cb-4f39-b98e-3a50a1b73fdb response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
45932025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
45942025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
45952025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
45962025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45972025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45982025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
45992025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46002025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46012025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 8 reason = Timeout
46022025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
46032025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46042025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46052025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
46062025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46072025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46082025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
46092025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46102025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
46112025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46122025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
46132025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46142025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
46152025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46162025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
46172025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
46182025-01-30T20:21:00.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46192025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46202025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46212025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
46222025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
46232025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46242025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46252025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
46262025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46272025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
46282025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46292025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
46302025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46312025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46322025-01-30T20:21:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46332025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46342025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46352025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46362025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46372025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46382025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46392025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46402025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46412025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46422025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46432025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46442025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46452025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46462025-01-30T20:21:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46472025-01-30T20:21:00.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46482025-01-30T20:21:00.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46492025-01-30T20:21:00.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46502025-01-30T20:21:00.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.054122ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46512025-01-30T20:21:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46522025-01-30T20:21:00.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46532025-01-30T20:21:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46542025-01-30T20:21:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46552025-01-30T20:21:00.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46562025-01-30T20:21:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46572025-01-30T20:21:00.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46582025-01-30T20:21:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46592025-01-30T20:21:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46602025-01-30T20:21:00.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46612025-01-30T20:21:00.811ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46622025-01-30T20:21:00.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46632025-01-30T20:21:00.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2412, tv_nsec: 22730228 } })
46642025-01-30T20:21:00.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2412, tv_nsec: 22813231 } })
46652025-01-30T20:21:00.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
46662025-01-30T20:21:00.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
46672025-01-30T20:21:00.813ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46682025-01-30T20:21:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46692025-01-30T20:21:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46702025-01-30T20:21:00.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46712025-01-30T20:21:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46722025-01-30T20:21:00.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46732025-01-30T20:21:00.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46742025-01-30T20:21:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46752025-01-30T20:21:00.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46762025-01-30T20:21:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46772025-01-30T20:21:00.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46782025-01-30T20:21:00.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46792025-01-30T20:21:00.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46802025-01-30T20:21:00.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46812025-01-30T20:21:00.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 22.595118ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46822025-01-30T20:21:00.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46832025-01-30T20:21:00.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46842025-01-30T20:21:00.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46852025-01-30T20:21:00.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46862025-01-30T20:21:00.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46872025-01-30T20:21:00.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46882025-01-30T20:21:00.828ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2412, tv_nsec: 38081714 } })
46892025-01-30T20:21:00.828ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
46902025-01-30T20:21:00.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
46912025-01-30T20:21:00.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46922025-01-30T20:21:00.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46932025-01-30T20:21:00.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46942025-01-30T20:21:00.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46952025-01-30T20:21:00.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46962025-01-30T20:21:00.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46972025-01-30T20:21:00.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46982025-01-30T20:21:00.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46992025-01-30T20:21:00.848ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47002025-01-30T20:21:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47012025-01-30T20:21:00.851ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47022025-01-30T20:21:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47032025-01-30T20:21:00.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47042025-01-30T20:21:00.851ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
47052025-01-30T20:21:00.851ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.276535ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
47062025-01-30T20:21:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47072025-01-30T20:21:00.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.662609ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
47082025-01-30T20:21:00.855ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47092025-01-30T20:21:00.855ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47102025-01-30T20:21:00.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47112025-01-30T20:21:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47122025-01-30T20:21:00.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47132025-01-30T20:21:00.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47142025-01-30T20:21:00.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47152025-01-30T20:21:00.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47162025-01-30T20:21:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47172025-01-30T20:21:00.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.187404ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47182025-01-30T20:21:00.860ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47192025-01-30T20:21:00.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47202025-01-30T20:21:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47212025-01-30T20:21:00.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47222025-01-30T20:21:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47232025-01-30T20:21:00.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.956878ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
47242025-01-30T20:21:00.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 64.174511ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47252025-01-30T20:21:00.870ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47262025-01-30T20:21:00.870ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.218831ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47272025-01-30T20:21:00.880ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47282025-01-30T20:21:00.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47292025-01-30T20:21:00.884ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47302025-01-30T20:21:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47312025-01-30T20:21:00.886ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47322025-01-30T20:21:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47332025-01-30T20:21:00.890ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47342025-01-30T20:21:00.890ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47352025-01-30T20:21:00.890ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47362025-01-30T20:21:00.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47372025-01-30T20:21:00.890ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 88.756183ms iteration = 10 status = {"physical_disks_added":0}
47382025-01-30T20:21:00.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47392025-01-30T20:21:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47402025-01-30T20:21:00.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47412025-01-30T20:21:00.905ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
47422025-01-30T20:21:00.905ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47432025-01-30T20:21:00.906ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "900cf42b-bb34-4e82-a267-6bbb132bf87c", "content-length": "26", "date": "Thu, 30 Jan 2025 20:21:00 GMT"} })
47442025-01-30T20:21:00.906ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47452025-01-30T20:21:00.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47462025-01-30T20:21:00.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
47472025-01-30T20:21:00.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47482025-01-30T20:21:00.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47492025-01-30T20:21:00.909ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 108.366818ms iteration = 8 status = 0
47502025-01-30T20:21:00.910ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
47512025-01-30T20:21:00.910ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47522025-01-30T20:21:00.910ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab50b77a-0b4d-40bb-a08b-a700eeea6801", "content-length": "26", "date": "Thu, 30 Jan 2025 20:21:00 GMT"} })
47532025-01-30T20:21:00.910ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47542025-01-30T20:21:00.911ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47552025-01-30T20:21:00.915ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
47562025-01-30T20:21:00.915ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 113.84277ms iteration = 8 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
47572025-01-30T20:21:00.921ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47582025-01-30T20:21:00.921ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47592025-01-30T20:21:00.921ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.96049ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47602025-01-30T20:21:00.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 124.129445ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
47612025-01-30T20:21:00.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
47622025-01-30T20:21:00.928ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47632025-01-30T20:21:00.928ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b877c6c-2394-4dba-9978-d14055e54478", "content-length": "26", "date": "Thu, 30 Jan 2025 20:21:00 GMT"} })
47642025-01-30T20:21:00.928ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47652025-01-30T20:21:00.930ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
47662025-01-30T20:21:00.941ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47672025-01-30T20:21:00.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47682025-01-30T20:21:00.943ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47692025-01-30T20:21:00.944ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47702025-01-30T20:21:00.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47712025-01-30T20:21:00.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47722025-01-30T20:21:01.000ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47732025-01-30T20:21:01.001ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "73ac43b7-8b20-4637-a27d-f1197e1b291e", "content-length": "1", "date": "Thu, 30 Jan 2025 20:21:00 GMT"} })
47742025-01-30T20:21:01.002ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47752025-01-30T20:21:01.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47762025-01-30T20:21:01.009ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 208.22935ms iteration = 8 status = {}
47772025-01-30T20:21:01.071ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47782025-01-30T20:21:01.072ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47792025-01-30T20:21:01.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "041aa519-0d74-416e-9e64-35dc7270fcb8", "content-length": "372", "date": "Thu, 30 Jan 2025 20:21:01 GMT"} })
47802025-01-30T20:21:01.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47812025-01-30T20:21:01.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47822025-01-30T20:21:01.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47832025-01-30T20:21:01.074ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 272.812281ms iteration = 8 status = null
47842025-01-30T20:21:01.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47852025-01-30T20:21:01.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47862025-01-30T20:21:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47872025-01-30T20:21:01.116ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47882025-01-30T20:21:01.116ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
47892025-01-30T20:21:01.116ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47902025-01-30T20:21:01.117ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "50326cd3-f770-40c3-9462-461ebf460422", "date": "Thu, 30 Jan 2025 20:21:01 GMT"} })
47912025-01-30T20:21:01.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47922025-01-30T20:21:01.117ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "58a7d41b-75c5-4dc9-8e6e-660a2759728e", "content-length": "691", "date": "Thu, 30 Jan 2025 20:21:01 GMT"} })
47932025-01-30T20:21:01.117ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
47942025-01-30T20:21:01.117ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
47952025-01-30T20:21:01.117ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
47962025-01-30T20:21:01.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47972025-01-30T20:21:01.118ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 317.228014ms iteration = 8 status = {}
47982025-01-30T20:21:01.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47992025-01-30T20:21:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48002025-01-30T20:21:01.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48012025-01-30T20:21:01.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48022025-01-30T20:21:01.129ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48032025-01-30T20:21:01.129ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48042025-01-30T20:21:01.129ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "12d75e47-5129-4e98-b614-a3a9cb3c8ec3", "date": "Thu, 30 Jan 2025 20:21:01 GMT"} })
48052025-01-30T20:21:01.131ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 329.645709ms iteration = 8 status = {}
48062025-01-30T20:21:01.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48072025-01-30T20:21:01.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48082025-01-30T20:21:01.166ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
48092025-01-30T20:21:01.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48102025-01-30T20:21:01.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48112025-01-30T20:21:01.175ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48122025-01-30T20:21:01.175ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "431186d7-028a-4baa-9ab4-b1750b1986b5", "content-length": "134", "date": "Thu, 30 Jan 2025 20:21:00 GMT"} })
48132025-01-30T20:21:01.175ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48142025-01-30T20:21:01.175ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
48152025-01-30T20:21:01.176ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48162025-01-30T20:21:01.176ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48172025-01-30T20:21:01.176ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48182025-01-30T20:21:01.176ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48192025-01-30T20:21:01.176ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48202025-01-30T20:21:01.176ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48212025-01-30T20:21:01.176ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48222025-01-30T20:21:01.176ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48232025-01-30T20:21:01.176ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
48242025-01-30T20:21:01.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48252025-01-30T20:21:01.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48262025-01-30T20:21:01.179ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48272025-01-30T20:21:01.179ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "06afbfac-8299-47bc-abd5-b6e7f205a119", "content-length": "2", "date": "Thu, 30 Jan 2025 20:21:00 GMT"} })
48282025-01-30T20:21:01.179ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48292025-01-30T20:21:01.179ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaff1eb2-4950-40b1-9e93-a9e26469cae6", "content-length": "52", "date": "Thu, 30 Jan 2025 20:21:00 GMT"} })
48302025-01-30T20:21:01.179ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
48312025-01-30T20:21:01.179ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48322025-01-30T20:21:01.329ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e4301530-c9a1-4aeb-b377-9b56d2975313", "date": "Thu, 30 Jan 2025 20:21:01 GMT"} })
48332025-01-30T20:21:01.329ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
48342025-01-30T20:21:01.330ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48352025-01-30T20:21:01.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 113671a9-17a1-4947-b9fa-c29c79a94f33 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48362025-01-30T20:21:01.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 113671a9-17a1-4947-b9fa-c29c79a94f33 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48372025-01-30T20:21:01.330ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a06fe0c4-a9b3-4dce-a9ee-4e1d7d3cdd59", "content-length": "682", "date": "Thu, 30 Jan 2025 20:21:01 GMT"} })
48382025-01-30T20:21:01.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48392025-01-30T20:21:01.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48402025-01-30T20:21:01.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 113671a9-17a1-4947-b9fa-c29c79a94f33 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48412025-01-30T20:21:01.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48422025-01-30T20:21:01.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48432025-01-30T20:21:01.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48442025-01-30T20:21:01.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48452025-01-30T20:21:01.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48462025-01-30T20:21:01.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48472025-01-30T20:21:01.351ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 550.358525ms iteration = 8 status = {}
48482025-01-30T20:21:01.392ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
48492025-01-30T20:21:01.392ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
48502025-01-30T20:21:01.422ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
48512025-01-30T20:21:01.422ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:53192
48522025-01-30T20:21:01.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:53192 req_id = 548df637-d766-40c4-9ba1-69d734053b03 roles = RoleSet { roles: {} } uri = /metrics/producers
48532025-01-30T20:21:01.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:53192 req_id = 548df637-d766-40c4-9ba1-69d734053b03 resource = Database result = Ok(()) uri = /metrics/producers
48542025-01-30T20:21:01.457ZINFOnexus: assigned collector to new producer collector_id = 623434f7-1950-4ff8-a21d-872e401e4248 file = nexus/src/app/oximeter.rs:76 producer_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
48552025-01-30T20:21:01.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34568 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:53192 req_id = 548df637-d766-40c4-9ba1-69d734053b03 response_code = 201 uri = /metrics/producers
48562025-01-30T20:21:01.457ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "548df637-d766-40c4-9ba1-69d734053b03", "content-length": "41", "date": "Thu, 30 Jan 2025 20:21:01 GMT"} })
48572025-01-30T20:21:01.459ZDEBGnexus (producer-registration-task): registered with nexus successfully
48582025-01-30T20:21:01.459ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
48592025-01-30T20:21:02.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 2dee0821-fbb6-4391-ba07-f89c7154e344 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
48602025-01-30T20:21:02.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 2dee0821-fbb6-4391-ba07-f89c7154e344 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
48612025-01-30T20:21:02.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 2dee0821-fbb6-4391-ba07-f89c7154e344 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
48622025-01-30T20:21:02.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e846b608-a3c9-4a58-86dd-94adf07813ec roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48632025-01-30T20:21:02.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e846b608-a3c9-4a58-86dd-94adf07813ec resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48642025-01-30T20:21:02.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e846b608-a3c9-4a58-86dd-94adf07813ec response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48652025-01-30T20:21:02.440ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:60718
48662025-01-30T20:21:02.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = 3619ba73-87a9-4ce7-b963-a6a1b6c99ef1 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
48672025-01-30T20:21:02.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = 3619ba73-87a9-4ce7-b963-a6a1b6c99ef1 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
48682025-01-30T20:21:02.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = 3619ba73-87a9-4ce7-b963-a6a1b6c99ef1 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
48692025-01-30T20:21:02.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = 13e50404-5705-4de1-afc0-16a723fa589b roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
48702025-01-30T20:21:02.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = 13e50404-5705-4de1-afc0-16a723fa589b resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
48712025-01-30T20:21:02.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = 13e50404-5705-4de1-afc0-16a723fa589b response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
48722025-01-30T20:21:02.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 519 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = d7c21529-a5c2-4a48-81b0-a781c1a677c7 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
48732025-01-30T20:21:03.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1c38bc73-f37a-4072-aca8-ffdeb2991b5f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48742025-01-30T20:21:03.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1c38bc73-f37a-4072-aca8-ffdeb2991b5f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48752025-01-30T20:21:03.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1c38bc73-f37a-4072-aca8-ffdeb2991b5f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48762025-01-30T20:21:04.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5b114f11-4aec-4c8d-b559-07708ef2ca6c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48772025-01-30T20:21:04.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5b114f11-4aec-4c8d-b559-07708ef2ca6c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48782025-01-30T20:21:04.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5b114f11-4aec-4c8d-b559-07708ef2ca6c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48792025-01-30T20:21:05.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a4906db1-8e71-4d0a-8851-5bf2853da2ea roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48802025-01-30T20:21:05.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a4906db1-8e71-4d0a-8851-5bf2853da2ea resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48812025-01-30T20:21:05.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a4906db1-8e71-4d0a-8851-5bf2853da2ea response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48822025-01-30T20:21:06.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1c8d0b72-bc85-4ded-ab75-323dbd719aa5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48832025-01-30T20:21:06.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1c8d0b72-bc85-4ded-ab75-323dbd719aa5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48842025-01-30T20:21:06.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1c8d0b72-bc85-4ded-ab75-323dbd719aa5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48852025-01-30T20:21:07.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a172b16e-9b63-49b8-9c2a-426d1296c7bf roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48862025-01-30T20:21:07.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a172b16e-9b63-49b8-9c2a-426d1296c7bf resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48872025-01-30T20:21:07.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a172b16e-9b63-49b8-9c2a-426d1296c7bf response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48882025-01-30T20:21:08.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d790a855-df3c-4c8e-b54e-77aaeb439b26 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48892025-01-30T20:21:08.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d790a855-df3c-4c8e-b54e-77aaeb439b26 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48902025-01-30T20:21:08.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d790a855-df3c-4c8e-b54e-77aaeb439b26 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48912025-01-30T20:21:09.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6235262e-617b-47e1-abca-10e41bde56c4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48922025-01-30T20:21:09.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6235262e-617b-47e1-abca-10e41bde56c4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48932025-01-30T20:21:09.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6235262e-617b-47e1-abca-10e41bde56c4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48942025-01-30T20:21:10.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cc3dcf48-6ef4-42ad-bdeb-b06fbbfdf9bc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48952025-01-30T20:21:10.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cc3dcf48-6ef4-42ad-bdeb-b06fbbfdf9bc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48962025-01-30T20:21:10.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cc3dcf48-6ef4-42ad-bdeb-b06fbbfdf9bc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
48972025-01-30T20:21:10.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
48982025-01-30T20:21:10.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
48992025-01-30T20:21:10.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49002025-01-30T20:21:10.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49012025-01-30T20:21:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49022025-01-30T20:21:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49032025-01-30T20:21:10.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49042025-01-30T20:21:10.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49052025-01-30T20:21:10.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49062025-01-30T20:21:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49072025-01-30T20:21:10.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49082025-01-30T20:21:10.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49092025-01-30T20:21:10.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49102025-01-30T20:21:10.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
49112025-01-30T20:21:10.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49122025-01-30T20:21:10.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49132025-01-30T20:21:10.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
49142025-01-30T20:21:10.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.583307ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
49152025-01-30T20:21:10.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49162025-01-30T20:21:10.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49172025-01-30T20:21:10.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.568343ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49182025-01-30T20:21:11.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ae4b175-a211-4e6d-9782-3446a1f42101 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49192025-01-30T20:21:11.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ae4b175-a211-4e6d-9782-3446a1f42101 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49202025-01-30T20:21:11.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ae4b175-a211-4e6d-9782-3446a1f42101 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49212025-01-30T20:21:12.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 565 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 57f99fad-5bb7-46a4-a206-7392bac7347b response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
49222025-01-30T20:21:12.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d2aae72a-29a9-4850-890f-437360ad6605 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49232025-01-30T20:21:12.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d2aae72a-29a9-4850-890f-437360ad6605 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49242025-01-30T20:21:12.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d2aae72a-29a9-4850-890f-437360ad6605 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49252025-01-30T20:21:13.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 534e17df-0ba0-470b-92c5-e078d4e513ed roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49262025-01-30T20:21:13.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 534e17df-0ba0-470b-92c5-e078d4e513ed resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49272025-01-30T20:21:13.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 534e17df-0ba0-470b-92c5-e078d4e513ed response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49282025-01-30T20:21:14.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6fcedcc3-1ecd-4afb-947f-0ab954da47ca roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49292025-01-30T20:21:14.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6fcedcc3-1ecd-4afb-947f-0ab954da47ca resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49302025-01-30T20:21:14.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6fcedcc3-1ecd-4afb-947f-0ab954da47ca response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49312025-01-30T20:21:15.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e656f392-71be-4ba1-9876-7b4edbb70cd9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49322025-01-30T20:21:15.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e656f392-71be-4ba1-9876-7b4edbb70cd9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49332025-01-30T20:21:15.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e656f392-71be-4ba1-9876-7b4edbb70cd9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49342025-01-30T20:21:16.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 01645920-db8f-47ae-a9b2-0e5d3cb1a1f4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49352025-01-30T20:21:16.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 01645920-db8f-47ae-a9b2-0e5d3cb1a1f4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49362025-01-30T20:21:16.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 01645920-db8f-47ae-a9b2-0e5d3cb1a1f4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49372025-01-30T20:21:17.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 355602b9-a407-4830-8d6b-f611194ef39d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49382025-01-30T20:21:17.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 355602b9-a407-4830-8d6b-f611194ef39d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49392025-01-30T20:21:17.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 355602b9-a407-4830-8d6b-f611194ef39d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49402025-01-30T20:21:18.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0a85c81b-54d7-4401-b9ba-39108aee972e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49412025-01-30T20:21:18.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0a85c81b-54d7-4401-b9ba-39108aee972e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49422025-01-30T20:21:18.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0a85c81b-54d7-4401-b9ba-39108aee972e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49432025-01-30T20:21:19.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 30761512-d99f-4bcd-83ea-944d58095292 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49442025-01-30T20:21:19.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 30761512-d99f-4bcd-83ea-944d58095292 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49452025-01-30T20:21:19.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 30761512-d99f-4bcd-83ea-944d58095292 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49462025-01-30T20:21:20.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 20400d33-0faf-4ff9-892b-de239d0feb43 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49472025-01-30T20:21:20.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 20400d33-0faf-4ff9-892b-de239d0feb43 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49482025-01-30T20:21:20.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 20400d33-0faf-4ff9-892b-de239d0feb43 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49492025-01-30T20:21:20.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
49502025-01-30T20:21:20.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
49512025-01-30T20:21:20.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49522025-01-30T20:21:20.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49532025-01-30T20:21:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49542025-01-30T20:21:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49552025-01-30T20:21:20.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49562025-01-30T20:21:20.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49572025-01-30T20:21:20.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49582025-01-30T20:21:20.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49592025-01-30T20:21:20.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49602025-01-30T20:21:20.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49612025-01-30T20:21:20.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49622025-01-30T20:21:20.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49632025-01-30T20:21:20.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49642025-01-30T20:21:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
49652025-01-30T20:21:20.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49662025-01-30T20:21:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49672025-01-30T20:21:20.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
49682025-01-30T20:21:20.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.003663ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
49692025-01-30T20:21:20.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.906148ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49702025-01-30T20:21:21.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 746a5f4c-594b-4805-a87d-954a38d92972 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49712025-01-30T20:21:21.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 746a5f4c-594b-4805-a87d-954a38d92972 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49722025-01-30T20:21:21.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 746a5f4c-594b-4805-a87d-954a38d92972 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49732025-01-30T20:21:22.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 468 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = d147fc84-5d8e-4780-82f1-88cf7aefc3e3 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
49742025-01-30T20:21:22.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0dfc9a96-085e-46ab-857f-70f789bf2e5a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49752025-01-30T20:21:22.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0dfc9a96-085e-46ab-857f-70f789bf2e5a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49762025-01-30T20:21:22.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0dfc9a96-085e-46ab-857f-70f789bf2e5a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49772025-01-30T20:21:23.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31794aa2-2c34-4fb4-b169-c7de5707cf70 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49782025-01-30T20:21:23.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31794aa2-2c34-4fb4-b169-c7de5707cf70 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49792025-01-30T20:21:23.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31794aa2-2c34-4fb4-b169-c7de5707cf70 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49802025-01-30T20:21:24.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 600dda92-b311-4d1e-9cdb-c9790a111577 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49812025-01-30T20:21:24.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 600dda92-b311-4d1e-9cdb-c9790a111577 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49822025-01-30T20:21:24.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 600dda92-b311-4d1e-9cdb-c9790a111577 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49832025-01-30T20:21:25.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 532f46a0-14fb-4933-a35f-a13be4bf16b0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49842025-01-30T20:21:25.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 532f46a0-14fb-4933-a35f-a13be4bf16b0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49852025-01-30T20:21:25.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 532f46a0-14fb-4933-a35f-a13be4bf16b0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49862025-01-30T20:21:26.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e02a17c7-a11b-4f26-8722-92c695493086 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49872025-01-30T20:21:26.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e02a17c7-a11b-4f26-8722-92c695493086 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49882025-01-30T20:21:26.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e02a17c7-a11b-4f26-8722-92c695493086 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49892025-01-30T20:21:27.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 864125a9-9e24-45d2-aa25-5a13a622cc36 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49902025-01-30T20:21:27.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 864125a9-9e24-45d2-aa25-5a13a622cc36 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49912025-01-30T20:21:27.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 864125a9-9e24-45d2-aa25-5a13a622cc36 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49922025-01-30T20:21:28.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6511e8c8-b851-443b-9a19-523b1f70b20e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49932025-01-30T20:21:28.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6511e8c8-b851-443b-9a19-523b1f70b20e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49942025-01-30T20:21:28.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6511e8c8-b851-443b-9a19-523b1f70b20e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49952025-01-30T20:21:29.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ddd8946e-ca31-41f2-90b6-43ae4db72716 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49962025-01-30T20:21:29.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ddd8946e-ca31-41f2-90b6-43ae4db72716 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49972025-01-30T20:21:29.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ddd8946e-ca31-41f2-90b6-43ae4db72716 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
49982025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
49992025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50002025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
50012025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
50022025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
50032025-01-30T20:21:30.801ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
50042025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
50052025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50062025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50072025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
50082025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
50092025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
50102025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
50112025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50122025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
50132025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50142025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
50152025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
50162025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50172025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
50182025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
50192025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50202025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50212025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
50222025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
50232025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50242025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50252025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
50262025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50272025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50282025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
50292025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
50302025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50312025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
50322025-01-30T20:21:30.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
50332025-01-30T20:21:30.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50342025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
50352025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.98\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
50362025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
50372025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 9 reason = Timeout
50382025-01-30T20:21:30.802ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:11:30.801949040 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50392025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50402025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50412025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
50422025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50432025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
50442025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50452025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
50462025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50472025-01-30T20:21:30.802ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50482025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50492025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
50502025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50512025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
50522025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50532025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
50542025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50552025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
50562025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
50572025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50582025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50592025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
50602025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
50612025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50622025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50632025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50642025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50652025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50662025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50672025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
50682025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50692025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50702025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
50712025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50722025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50732025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50742025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50752025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50762025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50772025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50782025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50792025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50802025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50812025-01-30T20:21:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2442, tv_nsec: 12555056 } })
50822025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50832025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50842025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50852025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50862025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
50872025-01-30T20:21:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2442, tv_nsec: 12601307 } })
50882025-01-30T20:21:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50892025-01-30T20:21:30.803ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
50902025-01-30T20:21:30.803ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
50912025-01-30T20:21:30.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.496351ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
50922025-01-30T20:21:30.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.130881ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
50932025-01-30T20:21:30.804ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50942025-01-30T20:21:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.525218ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
50952025-01-30T20:21:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.734783ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50962025-01-30T20:21:30.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
50972025-01-30T20:21:30.805ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50982025-01-30T20:21:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50992025-01-30T20:21:30.806ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.712801ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
51002025-01-30T20:21:30.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.020265ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
51012025-01-30T20:21:30.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51022025-01-30T20:21:30.809ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51032025-01-30T20:21:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51042025-01-30T20:21:30.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51052025-01-30T20:21:30.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51062025-01-30T20:21:30.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51072025-01-30T20:21:30.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2442, tv_nsec: 22040929 } })
51082025-01-30T20:21:30.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
51092025-01-30T20:21:30.812ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51102025-01-30T20:21:30.812ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51112025-01-30T20:21:30.812ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.175581ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51122025-01-30T20:21:30.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51132025-01-30T20:21:30.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51142025-01-30T20:21:30.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51152025-01-30T20:21:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51162025-01-30T20:21:30.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51172025-01-30T20:21:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51182025-01-30T20:21:30.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51192025-01-30T20:21:30.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51202025-01-30T20:21:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51212025-01-30T20:21:30.819ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2442, tv_nsec: 28975531 } })
51222025-01-30T20:21:30.819ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:11:30.801949040 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
51232025-01-30T20:21:30.819ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.229109ms iteration = 5 status = {"expiration":"2025-01-30T20:11:30.801949040Z","pruned":[]}
51242025-01-30T20:21:30.819ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
51252025-01-30T20:21:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51262025-01-30T20:21:30.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51272025-01-30T20:21:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51282025-01-30T20:21:30.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51292025-01-30T20:21:30.824ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51302025-01-30T20:21:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51312025-01-30T20:21:30.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51322025-01-30T20:21:30.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51332025-01-30T20:21:30.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51342025-01-30T20:21:30.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51352025-01-30T20:21:30.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51362025-01-30T20:21:30.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51372025-01-30T20:21:30.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51382025-01-30T20:21:30.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51392025-01-30T20:21:30.833ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51402025-01-30T20:21:30.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
51412025-01-30T20:21:30.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51422025-01-30T20:21:30.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51432025-01-30T20:21:30.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
51442025-01-30T20:21:30.836ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51452025-01-30T20:21:30.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51462025-01-30T20:21:30.849ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
51472025-01-30T20:21:30.849ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.54878ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
51482025-01-30T20:21:30.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51492025-01-30T20:21:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51502025-01-30T20:21:30.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.714709ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51512025-01-30T20:21:30.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51522025-01-30T20:21:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51532025-01-30T20:21:30.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51542025-01-30T20:21:30.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51552025-01-30T20:21:30.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51562025-01-30T20:21:30.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51572025-01-30T20:21:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51582025-01-30T20:21:30.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51592025-01-30T20:21:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51602025-01-30T20:21:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51612025-01-30T20:21:30.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51622025-01-30T20:21:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51632025-01-30T20:21:30.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51642025-01-30T20:21:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51652025-01-30T20:21:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51662025-01-30T20:21:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51672025-01-30T20:21:30.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51682025-01-30T20:21:30.866ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51692025-01-30T20:21:30.866ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51702025-01-30T20:21:30.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51712025-01-30T20:21:30.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51722025-01-30T20:21:30.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51732025-01-30T20:21:30.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 66.28628ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51742025-01-30T20:21:30.868ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
51752025-01-30T20:21:30.868ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
51762025-01-30T20:21:30.868ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 66.854235ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
51772025-01-30T20:21:30.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51782025-01-30T20:21:30.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51792025-01-30T20:21:30.869ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2442, tv_nsec: 79723500 } })
51802025-01-30T20:21:30.870ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
51812025-01-30T20:21:30.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51822025-01-30T20:21:30.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51832025-01-30T20:21:30.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51842025-01-30T20:21:30.871ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51852025-01-30T20:21:30.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51862025-01-30T20:21:30.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51872025-01-30T20:21:30.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51882025-01-30T20:21:30.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51892025-01-30T20:21:30.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51902025-01-30T20:21:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51912025-01-30T20:21:30.874ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51922025-01-30T20:21:30.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.918084ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51932025-01-30T20:21:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51942025-01-30T20:21:30.877ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51952025-01-30T20:21:30.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51962025-01-30T20:21:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51972025-01-30T20:21:30.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51982025-01-30T20:21:30.881ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
51992025-01-30T20:21:30.881ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52002025-01-30T20:21:30.881ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52012025-01-30T20:21:30.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52022025-01-30T20:21:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52032025-01-30T20:21:30.882ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
52042025-01-30T20:21:30.882ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
52052025-01-30T20:21:30.882ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
52062025-01-30T20:21:30.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52072025-01-30T20:21:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52082025-01-30T20:21:30.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52092025-01-30T20:21:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52102025-01-30T20:21:30.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52112025-01-30T20:21:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52122025-01-30T20:21:30.891ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52132025-01-30T20:21:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52142025-01-30T20:21:30.892ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
52152025-01-30T20:21:30.892ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
52162025-01-30T20:21:30.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52172025-01-30T20:21:30.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52182025-01-30T20:21:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52192025-01-30T20:21:30.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52202025-01-30T20:21:30.895ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52212025-01-30T20:21:30.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52222025-01-30T20:21:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52232025-01-30T20:21:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52242025-01-30T20:21:30.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52252025-01-30T20:21:30.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52262025-01-30T20:21:30.899ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
52272025-01-30T20:21:30.899ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
52282025-01-30T20:21:30.899ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-30 20:18:13.133071 UTC dns_group = external generation = 2
52292025-01-30T20:21:30.899ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 97.027763ms iteration = 5 status = {"generation":2}
52302025-01-30T20:21:30.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52312025-01-30T20:21:30.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52322025-01-30T20:21:30.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52332025-01-30T20:21:30.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52342025-01-30T20:21:30.903ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
52352025-01-30T20:21:30.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52362025-01-30T20:21:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52372025-01-30T20:21:30.905ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
52382025-01-30T20:21:30.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 107.840353ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
52392025-01-30T20:21:30.910ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52402025-01-30T20:21:30.910ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52412025-01-30T20:21:30.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52422025-01-30T20:21:30.910ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 108.82147ms iteration = 11 status = {"physical_disks_added":0}
52432025-01-30T20:21:30.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52442025-01-30T20:21:30.919ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52452025-01-30T20:21:30.919ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 117.056769ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52462025-01-30T20:21:30.924ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52472025-01-30T20:21:30.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52482025-01-30T20:21:30.926ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52492025-01-30T20:21:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
52502025-01-30T20:21:30.928ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52512025-01-30T20:21:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52522025-01-30T20:21:30.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52532025-01-30T20:21:30.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52542025-01-30T20:21:30.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52552025-01-30T20:21:30.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52562025-01-30T20:21:30.941ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) }
52572025-01-30T20:21:30.941ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 139.746908ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
52582025-01-30T20:21:30.942ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52592025-01-30T20:21:30.942ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52602025-01-30T20:21:30.942ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.585551ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52612025-01-30T20:21:30.943ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52622025-01-30T20:21:30.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
52632025-01-30T20:21:30.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52642025-01-30T20:21:30.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52652025-01-30T20:21:30.948ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 147.157894ms iteration = 9 status = 0
52662025-01-30T20:21:30.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52672025-01-30T20:21:30.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52682025-01-30T20:21:30.956ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
52692025-01-30T20:21:30.956ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 154.368354ms iteration = 9 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
52702025-01-30T20:21:30.961ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
52712025-01-30T20:21:30.961ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
52722025-01-30T20:21:30.961ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52732025-01-30T20:21:30.961ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
52742025-01-30T20:21:30.961ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52752025-01-30T20:21:30.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52762025-01-30T20:21:30.962ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aa21472-f5e6-451a-89d6-bd2ff8b36063", "content-length": "26", "date": "Thu, 30 Jan 2025 20:21:30 GMT"} })
52772025-01-30T20:21:30.962ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52782025-01-30T20:21:30.963ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52792025-01-30T20:21:30.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52802025-01-30T20:21:30.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52812025-01-30T20:21:30.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52822025-01-30T20:21:30.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52832025-01-30T20:21:30.973ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
52842025-01-30T20:21:30.973ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52852025-01-30T20:21:30.973ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bc00f3a-6f8a-46e7-9689-73162f6a747c", "content-length": "26", "date": "Thu, 30 Jan 2025 20:21:30 GMT"} })
52862025-01-30T20:21:30.973ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52872025-01-30T20:21:30.975ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52882025-01-30T20:21:30.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fcf0fa20-eba4-4e0e-9725-1ce024553ce6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
52892025-01-30T20:21:30.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fcf0fa20-eba4-4e0e-9725-1ce024553ce6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
52902025-01-30T20:21:31.001ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
52912025-01-30T20:21:31.001ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 199.506047ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
52922025-01-30T20:21:31.024ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
52932025-01-30T20:21:31.024ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52942025-01-30T20:21:31.024ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae4e4970-62d5-41c4-b385-0998b04f37b4", "content-length": "26", "date": "Thu, 30 Jan 2025 20:21:30 GMT"} })
52952025-01-30T20:21:31.024ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52962025-01-30T20:21:31.026ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
52972025-01-30T20:21:31.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52982025-01-30T20:21:31.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52992025-01-30T20:21:31.090ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
53002025-01-30T20:21:31.090ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3f7822ac-c132-4e5f-92b1-4543c1f5aa8d", "date": "Thu, 30 Jan 2025 20:21:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53012025-01-30T20:21:31.090ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53022025-01-30T20:21:31.092ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4172c475-3c51-4c33-8203-1171215bcbc3", "date": "Thu, 30 Jan 2025 20:21:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53032025-01-30T20:21:31.092ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53042025-01-30T20:21:31.093ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53052025-01-30T20:21:31.093ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 291.763358ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
53062025-01-30T20:21:31.096ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53072025-01-30T20:21:31.168ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53082025-01-30T20:21:31.169ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d97f8a07-8a57-43c8-af57-7cc6ed4743fe", "content-length": "1", "date": "Thu, 30 Jan 2025 20:21:30 GMT"} })
53092025-01-30T20:21:31.171ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53102025-01-30T20:21:31.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53112025-01-30T20:21:31.206ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53122025-01-30T20:21:31.206ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53132025-01-30T20:21:31.208ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6963b530-0d24-43e5-ad9b-d0127bda20d9", "content-length": "372", "date": "Thu, 30 Jan 2025 20:21:31 GMT"} })
53142025-01-30T20:21:31.208ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53152025-01-30T20:21:31.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53162025-01-30T20:21:31.211ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
53172025-01-30T20:21:31.211ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
53182025-01-30T20:21:31.211ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-30 20:18:12.536035 UTC dns_group = internal generation = 1
53192025-01-30T20:21:31.211ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 409.507525ms iteration = 5 status = {"generation":1}
53202025-01-30T20:21:31.211ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53212025-01-30T20:21:31.212ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 410.521374ms iteration = 9 status = null
53222025-01-30T20:21:31.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53232025-01-30T20:21:31.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53242025-01-30T20:21:31.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53252025-01-30T20:21:31.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fcf0fa20-eba4-4e0e-9725-1ce024553ce6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
53262025-01-30T20:21:31.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53272025-01-30T20:21:31.227ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53282025-01-30T20:21:31.227ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53292025-01-30T20:21:31.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53302025-01-30T20:21:31.230ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 428.541404ms iteration = 9 status = {}
53312025-01-30T20:21:31.238ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
53322025-01-30T20:21:31.239ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "07eb92d2-2fd2-4bf7-8d54-826369adf7c9", "date": "Thu, 30 Jan 2025 20:21:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53332025-01-30T20:21:31.239ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53342025-01-30T20:21:31.245ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "00468631-7bf8-48c6-b993-b5b4471abf58", "date": "Thu, 30 Jan 2025 20:21:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53352025-01-30T20:21:31.245ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53362025-01-30T20:21:31.247ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dfae70a1-9086-4532-be0f-04ee8c80f572", "date": "Thu, 30 Jan 2025 20:21:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53372025-01-30T20:21:31.247ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53382025-01-30T20:21:31.249ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
53392025-01-30T20:21:31.249ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 447.249683ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
53402025-01-30T20:21:31.288ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
53412025-01-30T20:21:31.288ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53422025-01-30T20:21:31.289ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c25c44d1-7f7a-4bb4-b51e-3d946b1b2855", "date": "Thu, 30 Jan 2025 20:21:31 GMT"} })
53432025-01-30T20:21:31.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53442025-01-30T20:21:31.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53452025-01-30T20:21:31.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53462025-01-30T20:21:31.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53472025-01-30T20:21:31.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53482025-01-30T20:21:31.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53492025-01-30T20:21:31.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53502025-01-30T20:21:31.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53512025-01-30T20:21:31.327ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
53522025-01-30T20:21:31.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53532025-01-30T20:21:31.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53542025-01-30T20:21:31.331ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53552025-01-30T20:21:31.331ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53562025-01-30T20:21:31.331ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6783fd6d-6bb3-4da5-b97b-5926a1ee3b4d", "date": "Thu, 30 Jan 2025 20:21:31 GMT"} })
53572025-01-30T20:21:31.333ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 531.284225ms iteration = 9 status = {}
53582025-01-30T20:21:31.346ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53592025-01-30T20:21:31.346ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "571b8e7d-8454-4d40-8245-0f52045bca21", "content-length": "134", "date": "Thu, 30 Jan 2025 20:21:30 GMT"} })
53602025-01-30T20:21:31.346ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53612025-01-30T20:21:31.346ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
53622025-01-30T20:21:31.347ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53632025-01-30T20:21:31.347ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53642025-01-30T20:21:31.347ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53652025-01-30T20:21:31.347ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53662025-01-30T20:21:31.347ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53672025-01-30T20:21:31.347ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53682025-01-30T20:21:31.347ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53692025-01-30T20:21:31.347ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53702025-01-30T20:21:31.347ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
53712025-01-30T20:21:31.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53722025-01-30T20:21:31.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53732025-01-30T20:21:31.349ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53742025-01-30T20:21:31.349ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1934117-f90a-42ee-b861-b50a43c72af1", "content-length": "2", "date": "Thu, 30 Jan 2025 20:21:30 GMT"} })
53752025-01-30T20:21:31.349ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53762025-01-30T20:21:31.349ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c003eba4-5609-42f4-8d79-98b68fdaf47c", "content-length": "52", "date": "Thu, 30 Jan 2025 20:21:30 GMT"} })
53772025-01-30T20:21:31.349ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
53782025-01-30T20:21:31.349ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53792025-01-30T20:21:31.378ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53802025-01-30T20:21:31.467ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "203648b8-3c60-444e-b704-b64c68c96f78", "date": "Thu, 30 Jan 2025 20:21:31 GMT"} })
53812025-01-30T20:21:31.467ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
53822025-01-30T20:21:31.467ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53832025-01-30T20:21:31.468ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8c32b8f-0aab-48de-8653-4d41b7e227c2", "content-length": "691", "date": "Thu, 30 Jan 2025 20:21:31 GMT"} })
53842025-01-30T20:21:31.468ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
53852025-01-30T20:21:31.468ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
53862025-01-30T20:21:31.468ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
53872025-01-30T20:21:31.468ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a0a082e-a5d3-46fc-b5fc-a26eb73758c6", "content-length": "682", "date": "Thu, 30 Jan 2025 20:21:31 GMT"} })
53882025-01-30T20:21:31.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53892025-01-30T20:21:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53902025-01-30T20:21:31.470ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 668.132164ms iteration = 9 status = {}
53912025-01-30T20:21:31.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53922025-01-30T20:21:31.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53932025-01-30T20:21:31.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53942025-01-30T20:21:31.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53952025-01-30T20:21:31.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53962025-01-30T20:21:31.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53972025-01-30T20:21:31.487ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 685.765624ms iteration = 9 status = {}
53982025-01-30T20:21:32.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8b8dfac1-e79a-4748-ab1b-1064c0ab6e09 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
53992025-01-30T20:21:32.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8b8dfac1-e79a-4748-ab1b-1064c0ab6e09 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54002025-01-30T20:21:32.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8b8dfac1-e79a-4748-ab1b-1064c0ab6e09 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54012025-01-30T20:21:32.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a7e76d9d-6ee0-4e06-a04d-2736a7975b4f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
54022025-01-30T20:21:32.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a7e76d9d-6ee0-4e06-a04d-2736a7975b4f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
54032025-01-30T20:21:32.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a7e76d9d-6ee0-4e06-a04d-2736a7975b4f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
54042025-01-30T20:21:32.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 473 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 117515fb-a5f4-4e17-a91e-384a27a8e51f response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
54052025-01-30T20:21:33.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7d9929ab-51df-4113-868d-59b8e156a683 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54062025-01-30T20:21:33.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7d9929ab-51df-4113-868d-59b8e156a683 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54072025-01-30T20:21:33.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7d9929ab-51df-4113-868d-59b8e156a683 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54082025-01-30T20:21:34.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = af48fd58-5ec4-4d68-a02d-411f8657f28d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54092025-01-30T20:21:34.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = af48fd58-5ec4-4d68-a02d-411f8657f28d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54102025-01-30T20:21:34.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = af48fd58-5ec4-4d68-a02d-411f8657f28d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54112025-01-30T20:21:35.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5984e22e-ec28-4102-9177-f7582ebdfd47 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54122025-01-30T20:21:35.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5984e22e-ec28-4102-9177-f7582ebdfd47 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54132025-01-30T20:21:35.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5984e22e-ec28-4102-9177-f7582ebdfd47 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54142025-01-30T20:21:36.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 95078d14-b7de-4705-b761-06f2418bcb1b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54152025-01-30T20:21:36.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 95078d14-b7de-4705-b761-06f2418bcb1b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54162025-01-30T20:21:36.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 95078d14-b7de-4705-b761-06f2418bcb1b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54172025-01-30T20:21:37.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3a8a301a-709a-494d-9dad-0a73ca8f2624 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54182025-01-30T20:21:37.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3a8a301a-709a-494d-9dad-0a73ca8f2624 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54192025-01-30T20:21:37.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3a8a301a-709a-494d-9dad-0a73ca8f2624 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54202025-01-30T20:21:38.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0503ef15-14bd-4e65-a930-ad3cc96f803b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54212025-01-30T20:21:38.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0503ef15-14bd-4e65-a930-ad3cc96f803b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54222025-01-30T20:21:38.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0503ef15-14bd-4e65-a930-ad3cc96f803b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54232025-01-30T20:21:39.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b966342a-7312-455c-982e-f8c051180305 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54242025-01-30T20:21:39.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b966342a-7312-455c-982e-f8c051180305 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54252025-01-30T20:21:39.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b966342a-7312-455c-982e-f8c051180305 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54262025-01-30T20:21:40.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ab611d4e-3f39-4ea2-9615-4c9681f69210 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54272025-01-30T20:21:40.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ab611d4e-3f39-4ea2-9615-4c9681f69210 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54282025-01-30T20:21:40.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ab611d4e-3f39-4ea2-9615-4c9681f69210 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54292025-01-30T20:21:40.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
54302025-01-30T20:21:40.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54312025-01-30T20:21:40.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
54322025-01-30T20:21:40.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54332025-01-30T20:21:40.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54342025-01-30T20:21:40.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54352025-01-30T20:21:40.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54362025-01-30T20:21:40.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54372025-01-30T20:21:40.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54382025-01-30T20:21:40.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.899654ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54392025-01-30T20:21:40.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54402025-01-30T20:21:40.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54412025-01-30T20:21:40.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54422025-01-30T20:21:40.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54432025-01-30T20:21:40.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54442025-01-30T20:21:40.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54452025-01-30T20:21:40.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
54462025-01-30T20:21:40.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54472025-01-30T20:21:40.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54482025-01-30T20:21:40.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
54492025-01-30T20:21:40.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.055313ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
54502025-01-30T20:21:41.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cf8d2479-eea5-4b1a-bf67-f5e556263ac5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54512025-01-30T20:21:41.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cf8d2479-eea5-4b1a-bf67-f5e556263ac5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54522025-01-30T20:21:41.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cf8d2479-eea5-4b1a-bf67-f5e556263ac5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54532025-01-30T20:21:42.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 488 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 177f93c2-b861-47b4-845d-f46180527ba5 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
54542025-01-30T20:21:42.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 65aa3ce7-5b4a-4798-b8d8-607b0d03c472 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54552025-01-30T20:21:42.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 65aa3ce7-5b4a-4798-b8d8-607b0d03c472 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54562025-01-30T20:21:42.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 65aa3ce7-5b4a-4798-b8d8-607b0d03c472 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54572025-01-30T20:21:43.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d301b3fc-7a6a-4c01-a6b0-33f76b3352c1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54582025-01-30T20:21:43.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d301b3fc-7a6a-4c01-a6b0-33f76b3352c1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54592025-01-30T20:21:43.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d301b3fc-7a6a-4c01-a6b0-33f76b3352c1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54602025-01-30T20:21:44.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d91327f9-6350-495d-afce-d429254a6a1f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54612025-01-30T20:21:44.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d91327f9-6350-495d-afce-d429254a6a1f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54622025-01-30T20:21:44.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d91327f9-6350-495d-afce-d429254a6a1f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54632025-01-30T20:21:45.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7e19bd4f-ae16-4df8-aa7a-a2840b11a496 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54642025-01-30T20:21:45.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7e19bd4f-ae16-4df8-aa7a-a2840b11a496 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54652025-01-30T20:21:45.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7e19bd4f-ae16-4df8-aa7a-a2840b11a496 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54662025-01-30T20:21:46.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 422e016b-b6c2-4ed5-aed2-ddf97a113221 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54672025-01-30T20:21:46.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 422e016b-b6c2-4ed5-aed2-ddf97a113221 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54682025-01-30T20:21:46.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 422e016b-b6c2-4ed5-aed2-ddf97a113221 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54692025-01-30T20:21:47.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9088ea01-5a84-4728-be62-3b5f44d6b089 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54702025-01-30T20:21:47.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9088ea01-5a84-4728-be62-3b5f44d6b089 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54712025-01-30T20:21:47.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9088ea01-5a84-4728-be62-3b5f44d6b089 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54722025-01-30T20:21:48.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6737b882-537d-4dd5-871e-9c1ce9548aae roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54732025-01-30T20:21:48.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6737b882-537d-4dd5-871e-9c1ce9548aae resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54742025-01-30T20:21:48.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6737b882-537d-4dd5-871e-9c1ce9548aae response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54752025-01-30T20:21:49.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 449edb60-98a2-48a9-b163-f3f175fb491b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54762025-01-30T20:21:49.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 449edb60-98a2-48a9-b163-f3f175fb491b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54772025-01-30T20:21:49.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 449edb60-98a2-48a9-b163-f3f175fb491b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54782025-01-30T20:21:50.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4708efa7-d378-48f5-8d41-09a5f6475e95 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54792025-01-30T20:21:50.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4708efa7-d378-48f5-8d41-09a5f6475e95 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54802025-01-30T20:21:50.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4708efa7-d378-48f5-8d41-09a5f6475e95 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
54812025-01-30T20:21:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
54822025-01-30T20:21:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
54832025-01-30T20:21:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54842025-01-30T20:21:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54852025-01-30T20:21:50.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54862025-01-30T20:21:50.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54872025-01-30T20:21:50.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54882025-01-30T20:21:50.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54892025-01-30T20:21:50.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54902025-01-30T20:21:50.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.364773ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54912025-01-30T20:21:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54922025-01-30T20:21:50.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54932025-01-30T20:21:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54942025-01-30T20:21:50.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54952025-01-30T20:21:50.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54962025-01-30T20:21:50.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54972025-01-30T20:21:50.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
54982025-01-30T20:21:50.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54992025-01-30T20:21:50.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55002025-01-30T20:21:50.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
55012025-01-30T20:21:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.426669ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
55022025-01-30T20:21:51.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = eac598a8-dd8a-431e-a4eb-7af87296faa7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55032025-01-30T20:21:51.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = eac598a8-dd8a-431e-a4eb-7af87296faa7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55042025-01-30T20:21:51.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = eac598a8-dd8a-431e-a4eb-7af87296faa7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55052025-01-30T20:21:52.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 567 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 4c564999-22d1-466d-b9ba-a752f591fb37 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
55062025-01-30T20:21:52.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5fc9b46d-21d6-47c4-ae85-ac9747d42d0d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55072025-01-30T20:21:52.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5fc9b46d-21d6-47c4-ae85-ac9747d42d0d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55082025-01-30T20:21:52.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5fc9b46d-21d6-47c4-ae85-ac9747d42d0d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55092025-01-30T20:21:53.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b0ea3981-a0dc-4039-bca1-e87fc2493a62 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55102025-01-30T20:21:53.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b0ea3981-a0dc-4039-bca1-e87fc2493a62 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55112025-01-30T20:21:53.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b0ea3981-a0dc-4039-bca1-e87fc2493a62 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55122025-01-30T20:21:54.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4d9af2fe-a28b-49b1-9aae-e1128bb3067c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55132025-01-30T20:21:54.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4d9af2fe-a28b-49b1-9aae-e1128bb3067c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55142025-01-30T20:21:54.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4d9af2fe-a28b-49b1-9aae-e1128bb3067c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55152025-01-30T20:21:55.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1de43bd1-789b-4b7d-af93-896ce8788b4f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55162025-01-30T20:21:55.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1de43bd1-789b-4b7d-af93-896ce8788b4f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55172025-01-30T20:21:55.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1de43bd1-789b-4b7d-af93-896ce8788b4f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55182025-01-30T20:21:56.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a02bc06-93da-4f7b-850f-4588585fd174 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55192025-01-30T20:21:56.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a02bc06-93da-4f7b-850f-4588585fd174 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55202025-01-30T20:21:56.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a02bc06-93da-4f7b-850f-4588585fd174 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55212025-01-30T20:21:57.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c0dcf918-f4ba-4876-ae3d-b39d67285e71 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55222025-01-30T20:21:57.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c0dcf918-f4ba-4876-ae3d-b39d67285e71 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55232025-01-30T20:21:57.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c0dcf918-f4ba-4876-ae3d-b39d67285e71 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55242025-01-30T20:21:58.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d020be28-441c-42b0-b743-3b6da34b29b3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55252025-01-30T20:21:58.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d020be28-441c-42b0-b743-3b6da34b29b3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55262025-01-30T20:21:58.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d020be28-441c-42b0-b743-3b6da34b29b3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55272025-01-30T20:21:59.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 879b7062-46ed-4563-b9a4-331e5ce7cae9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55282025-01-30T20:21:59.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 879b7062-46ed-4563-b9a4-331e5ce7cae9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55292025-01-30T20:21:59.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 879b7062-46ed-4563-b9a4-331e5ce7cae9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
55302025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
55312025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
55322025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55332025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
55342025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55352025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55362025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
55372025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55382025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
55392025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55402025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
55412025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
55422025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55432025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
55442025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55452025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55462025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
55472025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55482025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
55492025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
55502025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55512025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
55522025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
55532025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55542025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55552025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
55562025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55572025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
55582025-01-30T20:22:00.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
55592025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
55602025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55612025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55622025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
55632025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
55642025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
55652025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55662025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55672025-01-30T20:22:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55682025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55692025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55702025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55712025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55722025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55732025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55742025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55752025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
55762025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55772025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
55782025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55792025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55802025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
55812025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55822025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55832025-01-30T20:22:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55842025-01-30T20:22:00.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55852025-01-30T20:22:00.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.168956ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
55862025-01-30T20:22:00.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2472, tv_nsec: 16027832 } })
55872025-01-30T20:22:00.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55882025-01-30T20:22:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55892025-01-30T20:22:00.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55902025-01-30T20:22:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55912025-01-30T20:22:00.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
55922025-01-30T20:22:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55932025-01-30T20:22:00.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55942025-01-30T20:22:00.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55952025-01-30T20:22:00.809ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55962025-01-30T20:22:00.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
55972025-01-30T20:22:00.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55982025-01-30T20:22:00.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55992025-01-30T20:22:00.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56002025-01-30T20:22:00.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56012025-01-30T20:22:00.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2472, tv_nsec: 21157864 } })
56022025-01-30T20:22:00.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56032025-01-30T20:22:00.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
56042025-01-30T20:22:00.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
56052025-01-30T20:22:00.812ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56062025-01-30T20:22:00.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56072025-01-30T20:22:00.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56082025-01-30T20:22:00.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56092025-01-30T20:22:00.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56102025-01-30T20:22:00.814ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56112025-01-30T20:22:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56122025-01-30T20:22:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56132025-01-30T20:22:00.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56142025-01-30T20:22:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56152025-01-30T20:22:00.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56162025-01-30T20:22:00.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56172025-01-30T20:22:00.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56182025-01-30T20:22:00.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
56192025-01-30T20:22:00.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56202025-01-30T20:22:00.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56212025-01-30T20:22:00.819ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56222025-01-30T20:22:00.820ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56232025-01-30T20:22:00.820ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56242025-01-30T20:22:00.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56252025-01-30T20:22:00.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56262025-01-30T20:22:00.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56272025-01-30T20:22:00.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2472, tv_nsec: 31510622 } })
56282025-01-30T20:22:00.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
56292025-01-30T20:22:00.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56302025-01-30T20:22:00.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56312025-01-30T20:22:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56322025-01-30T20:22:00.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56332025-01-30T20:22:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56342025-01-30T20:22:00.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56352025-01-30T20:22:00.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56362025-01-30T20:22:00.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56372025-01-30T20:22:00.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56382025-01-30T20:22:00.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56392025-01-30T20:22:00.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56402025-01-30T20:22:00.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56412025-01-30T20:22:00.831ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56422025-01-30T20:22:00.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56432025-01-30T20:22:00.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56442025-01-30T20:22:00.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56452025-01-30T20:22:00.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.806735ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
56462025-01-30T20:22:00.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56472025-01-30T20:22:00.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56482025-01-30T20:22:00.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 41.989635ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56492025-01-30T20:22:00.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56502025-01-30T20:22:00.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56512025-01-30T20:22:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56522025-01-30T20:22:00.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.463518ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
56532025-01-30T20:22:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56542025-01-30T20:22:00.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 45.297198ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
56552025-01-30T20:22:00.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56562025-01-30T20:22:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56572025-01-30T20:22:00.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56582025-01-30T20:22:00.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
56592025-01-30T20:22:00.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56602025-01-30T20:22:00.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 49.493484ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56612025-01-30T20:22:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56622025-01-30T20:22:00.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56632025-01-30T20:22:00.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.628556ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56642025-01-30T20:22:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56652025-01-30T20:22:00.852ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 51.210901ms iteration = 10 status = 0
56662025-01-30T20:22:00.853ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56672025-01-30T20:22:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
56682025-01-30T20:22:00.855ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56692025-01-30T20:22:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56702025-01-30T20:22:00.856ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56712025-01-30T20:22:00.856ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56722025-01-30T20:22:00.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56732025-01-30T20:22:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56742025-01-30T20:22:00.857ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
56752025-01-30T20:22:00.857ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 55.941563ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
56762025-01-30T20:22:00.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56772025-01-30T20:22:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
56782025-01-30T20:22:00.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56792025-01-30T20:22:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56802025-01-30T20:22:00.861ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56812025-01-30T20:22:00.861ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.405937ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
56822025-01-30T20:22:00.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 831549e1-2651-40eb-b133-2149a799e6f4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
56832025-01-30T20:22:00.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 831549e1-2651-40eb-b133-2149a799e6f4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
56842025-01-30T20:22:00.878ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
56852025-01-30T20:22:00.878ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.081619ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
56862025-01-30T20:22:00.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 831549e1-2651-40eb-b133-2149a799e6f4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
56872025-01-30T20:22:00.888ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
56882025-01-30T20:22:00.888ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56892025-01-30T20:22:00.888ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5edf92ad-61c6-4036-983d-dc14beba87c0", "content-length": "26", "date": "Thu, 30 Jan 2025 20:22:00 GMT"} })
56902025-01-30T20:22:00.888ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56912025-01-30T20:22:00.890ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56922025-01-30T20:22:00.895ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56932025-01-30T20:22:00.895ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56942025-01-30T20:22:00.895ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 93.950308ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56952025-01-30T20:22:00.903ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
56962025-01-30T20:22:00.903ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56972025-01-30T20:22:00.904ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29b77ccc-42d0-444a-a78a-5dc62e36b815", "content-length": "26", "date": "Thu, 30 Jan 2025 20:22:00 GMT"} })
56982025-01-30T20:22:00.904ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56992025-01-30T20:22:00.905ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57002025-01-30T20:22:00.913ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
57012025-01-30T20:22:00.913ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57022025-01-30T20:22:00.913ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba679fa3-56aa-42a6-ab6a-6b36dad79b80", "content-length": "26", "date": "Thu, 30 Jan 2025 20:22:00 GMT"} })
57032025-01-30T20:22:00.913ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57042025-01-30T20:22:00.915ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
57052025-01-30T20:22:00.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57062025-01-30T20:22:00.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57072025-01-30T20:22:00.928ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 127.380826ms iteration = 12 status = {"physical_disks_added":0}
57082025-01-30T20:22:01.007ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57092025-01-30T20:22:01.007ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d77111ba-1448-465b-9e39-1bf32f563559", "content-length": "1", "date": "Thu, 30 Jan 2025 20:22:00 GMT"} })
57102025-01-30T20:22:01.008ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57112025-01-30T20:22:01.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57122025-01-30T20:22:01.012ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57132025-01-30T20:22:01.012ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57142025-01-30T20:22:01.012ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9de9c5c8-470f-43ce-bb2d-2a57278f704c", "content-length": "372", "date": "Thu, 30 Jan 2025 20:22:01 GMT"} })
57152025-01-30T20:22:01.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57162025-01-30T20:22:01.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57172025-01-30T20:22:01.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57182025-01-30T20:22:01.015ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 213.609448ms iteration = 10 status = null
57192025-01-30T20:22:01.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57202025-01-30T20:22:01.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57212025-01-30T20:22:01.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57222025-01-30T20:22:01.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57232025-01-30T20:22:01.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57242025-01-30T20:22:01.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57252025-01-30T20:22:01.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57262025-01-30T20:22:01.026ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
57272025-01-30T20:22:01.026ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57282025-01-30T20:22:01.026ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "47ee64de-9577-4f54-bc45-153e55fc82d5", "date": "Thu, 30 Jan 2025 20:22:01 GMT"} })
57292025-01-30T20:22:01.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57302025-01-30T20:22:01.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57312025-01-30T20:22:01.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57322025-01-30T20:22:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57332025-01-30T20:22:01.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57342025-01-30T20:22:01.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57352025-01-30T20:22:01.034ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57362025-01-30T20:22:01.034ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57372025-01-30T20:22:01.034ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2113b64b-61a3-45c6-9094-fbca596196e2", "date": "Thu, 30 Jan 2025 20:22:01 GMT"} })
57382025-01-30T20:22:01.035ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 234.087677ms iteration = 10 status = {}
57392025-01-30T20:22:01.110ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 308.77797ms iteration = 10 status = {}
57402025-01-30T20:22:01.117ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57412025-01-30T20:22:01.117ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3b3c4d9-8dab-4160-854a-c5197bff22db", "content-length": "691", "date": "Thu, 30 Jan 2025 20:22:01 GMT"} })
57422025-01-30T20:22:01.117ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
57432025-01-30T20:22:01.117ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
57442025-01-30T20:22:01.117ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
57452025-01-30T20:22:01.118ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 317.150863ms iteration = 10 status = {}
57462025-01-30T20:22:01.193ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57472025-01-30T20:22:01.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57482025-01-30T20:22:01.196ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
57492025-01-30T20:22:01.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57502025-01-30T20:22:01.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57512025-01-30T20:22:01.212ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57522025-01-30T20:22:01.212ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b33bbae-51ad-4688-a1e1-f5829722c0d2", "content-length": "134", "date": "Thu, 30 Jan 2025 20:22:00 GMT"} })
57532025-01-30T20:22:01.212ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57542025-01-30T20:22:01.212ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
57552025-01-30T20:22:01.212ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57562025-01-30T20:22:01.212ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57572025-01-30T20:22:01.212ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57582025-01-30T20:22:01.212ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57592025-01-30T20:22:01.212ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57602025-01-30T20:22:01.212ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57612025-01-30T20:22:01.213ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57622025-01-30T20:22:01.213ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57632025-01-30T20:22:01.213ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
57642025-01-30T20:22:01.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57652025-01-30T20:22:01.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57662025-01-30T20:22:01.216ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57672025-01-30T20:22:01.216ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a6231b9-6aeb-4683-bf01-2c3b48d2c0b9", "content-length": "2", "date": "Thu, 30 Jan 2025 20:22:00 GMT"} })
57682025-01-30T20:22:01.216ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57692025-01-30T20:22:01.216ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f7687c6-ea64-4fee-a72e-a5cee272d9ab", "content-length": "52", "date": "Thu, 30 Jan 2025 20:22:00 GMT"} })
57702025-01-30T20:22:01.216ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
57712025-01-30T20:22:01.216ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57722025-01-30T20:22:01.355ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "71bc5b61-2cef-41cf-88d5-e2682a8415fc", "date": "Thu, 30 Jan 2025 20:22:01 GMT"} })
57732025-01-30T20:22:01.355ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
57742025-01-30T20:22:01.355ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57752025-01-30T20:22:01.356ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "39740c05-5ca4-4105-abe1-7dc7aacebcf7", "content-length": "682", "date": "Thu, 30 Jan 2025 20:22:01 GMT"} })
57762025-01-30T20:22:01.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57772025-01-30T20:22:01.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57782025-01-30T20:22:01.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57792025-01-30T20:22:01.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57802025-01-30T20:22:01.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57812025-01-30T20:22:01.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57822025-01-30T20:22:01.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57832025-01-30T20:22:01.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57842025-01-30T20:22:01.374ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 572.754437ms iteration = 10 status = {}
57852025-01-30T20:22:01.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6b19e54c-b692-4262-a945-f375ef0a4fdc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
57862025-01-30T20:22:01.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6b19e54c-b692-4262-a945-f375ef0a4fdc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
57872025-01-30T20:22:01.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6b19e54c-b692-4262-a945-f375ef0a4fdc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
57882025-01-30T20:22:02.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 203f2aa8-e280-4274-8ca6-fded6b6ea75d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
57892025-01-30T20:22:02.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 203f2aa8-e280-4274-8ca6-fded6b6ea75d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
57902025-01-30T20:22:02.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 203f2aa8-e280-4274-8ca6-fded6b6ea75d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
57912025-01-30T20:22:02.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 531 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 0080a91a-3745-49ee-a5d4-6ae61fa28eb0 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
57922025-01-30T20:22:02.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6fc18af8-281a-4402-842b-4342a5945fa0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
57932025-01-30T20:22:02.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6fc18af8-281a-4402-842b-4342a5945fa0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
57942025-01-30T20:22:02.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6fc18af8-281a-4402-842b-4342a5945fa0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
57952025-01-30T20:22:03.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 499959c2-02d1-482f-a4f6-59cc3262b37f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
57962025-01-30T20:22:03.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 499959c2-02d1-482f-a4f6-59cc3262b37f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
57972025-01-30T20:22:03.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 499959c2-02d1-482f-a4f6-59cc3262b37f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
57982025-01-30T20:22:04.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a28669c2-ca9a-415d-92b8-0fd5beb3ef84 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
57992025-01-30T20:22:04.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a28669c2-ca9a-415d-92b8-0fd5beb3ef84 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58002025-01-30T20:22:04.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a28669c2-ca9a-415d-92b8-0fd5beb3ef84 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58012025-01-30T20:22:05.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ee78533a-09ed-4820-bd75-1bdbcda4ccb5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58022025-01-30T20:22:05.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ee78533a-09ed-4820-bd75-1bdbcda4ccb5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58032025-01-30T20:22:05.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ee78533a-09ed-4820-bd75-1bdbcda4ccb5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58042025-01-30T20:22:07.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9a9e46ea-8f92-4178-bb20-8aedbc6d7934 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58052025-01-30T20:22:07.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9a9e46ea-8f92-4178-bb20-8aedbc6d7934 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58062025-01-30T20:22:07.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9a9e46ea-8f92-4178-bb20-8aedbc6d7934 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58072025-01-30T20:22:08.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 38bb8a4d-5b55-409e-b55b-4fa815fefab2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58082025-01-30T20:22:08.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 38bb8a4d-5b55-409e-b55b-4fa815fefab2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58092025-01-30T20:22:08.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 38bb8a4d-5b55-409e-b55b-4fa815fefab2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58102025-01-30T20:22:09.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f63d6161-6877-4566-84c6-687dc59f70b6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58112025-01-30T20:22:09.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f63d6161-6877-4566-84c6-687dc59f70b6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58122025-01-30T20:22:09.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f63d6161-6877-4566-84c6-687dc59f70b6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58132025-01-30T20:22:10.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2ca2fd41-4bf7-405a-8537-32a73f80a9b8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58142025-01-30T20:22:10.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2ca2fd41-4bf7-405a-8537-32a73f80a9b8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58152025-01-30T20:22:10.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2ca2fd41-4bf7-405a-8537-32a73f80a9b8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58162025-01-30T20:22:10.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
58172025-01-30T20:22:10.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
58182025-01-30T20:22:10.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58192025-01-30T20:22:10.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58202025-01-30T20:22:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58212025-01-30T20:22:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58222025-01-30T20:22:10.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58232025-01-30T20:22:10.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58242025-01-30T20:22:10.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58252025-01-30T20:22:10.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.020552ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58262025-01-30T20:22:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58272025-01-30T20:22:10.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58282025-01-30T20:22:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58292025-01-30T20:22:10.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58302025-01-30T20:22:10.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58312025-01-30T20:22:10.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58322025-01-30T20:22:10.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
58332025-01-30T20:22:10.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58342025-01-30T20:22:10.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58352025-01-30T20:22:10.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
58362025-01-30T20:22:10.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.537277ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
58372025-01-30T20:22:11.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 36a06ba2-a99b-440c-a771-a415f9be63dd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58382025-01-30T20:22:11.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 36a06ba2-a99b-440c-a771-a415f9be63dd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58392025-01-30T20:22:11.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 36a06ba2-a99b-440c-a771-a415f9be63dd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58402025-01-30T20:22:12.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4824ad75-d7b8-44bc-8108-9e792b6f726c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58412025-01-30T20:22:12.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4824ad75-d7b8-44bc-8108-9e792b6f726c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58422025-01-30T20:22:12.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4824ad75-d7b8-44bc-8108-9e792b6f726c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58432025-01-30T20:22:12.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 459 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 79f0aa54-d3aa-43c1-af32-9cacc123e4c8 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
58442025-01-30T20:22:13.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6fc4d0d2-7420-4091-8933-8df814a88eba roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58452025-01-30T20:22:13.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6fc4d0d2-7420-4091-8933-8df814a88eba resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58462025-01-30T20:22:13.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6fc4d0d2-7420-4091-8933-8df814a88eba response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58472025-01-30T20:22:14.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1f9a6bd2-216c-4084-9d6b-1daf8bd51925 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58482025-01-30T20:22:14.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1f9a6bd2-216c-4084-9d6b-1daf8bd51925 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58492025-01-30T20:22:14.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1f9a6bd2-216c-4084-9d6b-1daf8bd51925 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58502025-01-30T20:22:15.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6996315c-8f90-43e1-a1ee-8ee7e0378d50 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58512025-01-30T20:22:15.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6996315c-8f90-43e1-a1ee-8ee7e0378d50 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58522025-01-30T20:22:15.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6996315c-8f90-43e1-a1ee-8ee7e0378d50 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58532025-01-30T20:22:16.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9e6fbcb0-501f-43ac-92ae-2452c5072e00 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58542025-01-30T20:22:16.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9e6fbcb0-501f-43ac-92ae-2452c5072e00 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58552025-01-30T20:22:16.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9e6fbcb0-501f-43ac-92ae-2452c5072e00 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58562025-01-30T20:22:17.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1867fd3e-0975-4860-a2c3-eb74ce501b53 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58572025-01-30T20:22:17.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1867fd3e-0975-4860-a2c3-eb74ce501b53 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58582025-01-30T20:22:17.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1867fd3e-0975-4860-a2c3-eb74ce501b53 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58592025-01-30T20:22:18.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 16ee1c22-9d6c-49c0-a7d6-6841fd9dfb23 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58602025-01-30T20:22:18.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 16ee1c22-9d6c-49c0-a7d6-6841fd9dfb23 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58612025-01-30T20:22:18.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 16ee1c22-9d6c-49c0-a7d6-6841fd9dfb23 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58622025-01-30T20:22:19.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 58975807-13b1-4daf-9a0a-6e8e73939ce5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58632025-01-30T20:22:19.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 58975807-13b1-4daf-9a0a-6e8e73939ce5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58642025-01-30T20:22:19.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 58975807-13b1-4daf-9a0a-6e8e73939ce5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58652025-01-30T20:22:20.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9a9a9b9e-b64b-4cb3-b8c8-075533003381 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58662025-01-30T20:22:20.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9a9a9b9e-b64b-4cb3-b8c8-075533003381 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58672025-01-30T20:22:20.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9a9a9b9e-b64b-4cb3-b8c8-075533003381 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58682025-01-30T20:22:20.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
58692025-01-30T20:22:20.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
58702025-01-30T20:22:20.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58712025-01-30T20:22:20.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58722025-01-30T20:22:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58732025-01-30T20:22:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58742025-01-30T20:22:20.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58752025-01-30T20:22:20.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58762025-01-30T20:22:20.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58772025-01-30T20:22:20.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.281898ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58782025-01-30T20:22:20.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58792025-01-30T20:22:20.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58802025-01-30T20:22:20.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58812025-01-30T20:22:20.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58822025-01-30T20:22:20.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58832025-01-30T20:22:20.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58842025-01-30T20:22:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
58852025-01-30T20:22:20.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58862025-01-30T20:22:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58872025-01-30T20:22:20.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
58882025-01-30T20:22:20.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.274863ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
58892025-01-30T20:22:21.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 54be094c-0647-44f2-a84b-8e7a27d3e6e1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58902025-01-30T20:22:21.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 54be094c-0647-44f2-a84b-8e7a27d3e6e1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58912025-01-30T20:22:21.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 54be094c-0647-44f2-a84b-8e7a27d3e6e1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58922025-01-30T20:22:22.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 65abf4df-5888-4a1c-a179-f356424d14c1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58932025-01-30T20:22:22.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 65abf4df-5888-4a1c-a179-f356424d14c1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58942025-01-30T20:22:22.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 65abf4df-5888-4a1c-a179-f356424d14c1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58952025-01-30T20:22:22.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 625 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 15e81135-1dd2-48f1-b8b7-d4836d650ad5 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
58962025-01-30T20:22:23.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b4b7a9aa-778a-4a62-a045-03f036bc62c3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58972025-01-30T20:22:23.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b4b7a9aa-778a-4a62-a045-03f036bc62c3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58982025-01-30T20:22:23.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b4b7a9aa-778a-4a62-a045-03f036bc62c3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
58992025-01-30T20:22:24.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5858742a-825a-44e5-b0c5-b3384f3931ae roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59002025-01-30T20:22:24.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5858742a-825a-44e5-b0c5-b3384f3931ae resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59012025-01-30T20:22:24.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5858742a-825a-44e5-b0c5-b3384f3931ae response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59022025-01-30T20:22:25.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b4118ff0-35e6-4fe5-9c98-a11c42dcf9aa roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59032025-01-30T20:22:25.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b4118ff0-35e6-4fe5-9c98-a11c42dcf9aa resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59042025-01-30T20:22:25.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b4118ff0-35e6-4fe5-9c98-a11c42dcf9aa response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59052025-01-30T20:22:26.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b908b23d-17a3-49a0-8470-19e58945d4be roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59062025-01-30T20:22:26.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b908b23d-17a3-49a0-8470-19e58945d4be resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59072025-01-30T20:22:26.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b908b23d-17a3-49a0-8470-19e58945d4be response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59082025-01-30T20:22:27.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = abac75ab-11cf-4fd9-b640-e7a3450ab5ee roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59092025-01-30T20:22:27.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = abac75ab-11cf-4fd9-b640-e7a3450ab5ee resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59102025-01-30T20:22:27.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = abac75ab-11cf-4fd9-b640-e7a3450ab5ee response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59112025-01-30T20:22:28.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c27995dd-2841-4f88-a520-f8df0bb8abac roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59122025-01-30T20:22:28.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c27995dd-2841-4f88-a520-f8df0bb8abac resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59132025-01-30T20:22:28.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c27995dd-2841-4f88-a520-f8df0bb8abac response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59142025-01-30T20:22:29.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a1d3ba8e-4d51-41a6-8cb6-44d2e4868296 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59152025-01-30T20:22:29.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a1d3ba8e-4d51-41a6-8cb6-44d2e4868296 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59162025-01-30T20:22:29.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a1d3ba8e-4d51-41a6-8cb6-44d2e4868296 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59172025-01-30T20:22:30.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 652f2b6c-c248-47f6-b8f7-fe998ecc734d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59182025-01-30T20:22:30.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 652f2b6c-c248-47f6-b8f7-fe998ecc734d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59192025-01-30T20:22:30.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 652f2b6c-c248-47f6-b8f7-fe998ecc734d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
59202025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
59212025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
59222025-01-30T20:22:30.801ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
59232025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
59242025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59252025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59262025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
59272025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59282025-01-30T20:22:30.801ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
59292025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59302025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 2 reason = Timeout
59312025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
59322025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
59332025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
59342025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
59352025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
59362025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59372025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
59382025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
59392025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
59402025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59412025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
59422025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
59432025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59442025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
59452025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59462025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
59472025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59482025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
59492025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59502025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
59512025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
59522025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59532025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59542025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
59552025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
59562025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59572025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59582025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
59592025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
59602025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
59612025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59622025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
59632025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
59642025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59652025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
59662025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
59672025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
59682025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59692025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
59702025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59712025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
59722025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
59732025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
59742025-01-30T20:22:30.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
59752025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
59762025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.901\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
59772025-01-30T20:22:30.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
59782025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
59792025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59802025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
59812025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59822025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59832025-01-30T20:22:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59842025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59852025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
59862025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
59872025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
59882025-01-30T20:22:30.802ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:12:30.801771562 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
59892025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
59902025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
59912025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59922025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
59932025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
59942025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59952025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59962025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59972025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59982025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59992025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60002025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60012025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
60022025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60032025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60042025-01-30T20:22:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2502, tv_nsec: 12034881 } })
60052025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60062025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
60072025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60082025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60092025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60102025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60112025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
60122025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60132025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60142025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60152025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
60162025-01-30T20:22:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2502, tv_nsec: 12159255 } })
60172025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60182025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60192025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60202025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60212025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
60222025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.040079ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
60232025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
60242025-01-30T20:22:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.178263ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
60252025-01-30T20:22:30.803ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60262025-01-30T20:22:30.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60272025-01-30T20:22:30.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60282025-01-30T20:22:30.804ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60292025-01-30T20:22:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.759304ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60302025-01-30T20:22:30.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
60312025-01-30T20:22:30.805ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60322025-01-30T20:22:30.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60332025-01-30T20:22:30.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60342025-01-30T20:22:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60352025-01-30T20:22:30.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
60362025-01-30T20:22:30.807ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
60372025-01-30T20:22:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
60382025-01-30T20:22:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60392025-01-30T20:22:30.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60402025-01-30T20:22:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60412025-01-30T20:22:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60422025-01-30T20:22:30.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60432025-01-30T20:22:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60442025-01-30T20:22:30.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60452025-01-30T20:22:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60462025-01-30T20:22:30.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60472025-01-30T20:22:30.811ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.908355ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
60482025-01-30T20:22:30.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2502, tv_nsec: 21408771 } })
60492025-01-30T20:22:30.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
60502025-01-30T20:22:30.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.776769ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
60512025-01-30T20:22:30.812ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60522025-01-30T20:22:30.813ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:12:30.801771562 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
60532025-01-30T20:22:30.813ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.818258ms iteration = 6 status = {"expiration":"2025-01-30T20:12:30.801771562Z","pruned":[]}
60542025-01-30T20:22:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
60552025-01-30T20:22:30.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
60562025-01-30T20:22:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
60572025-01-30T20:22:30.814ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60582025-01-30T20:22:30.814ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60592025-01-30T20:22:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60602025-01-30T20:22:30.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60612025-01-30T20:22:30.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60622025-01-30T20:22:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60632025-01-30T20:22:30.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60642025-01-30T20:22:30.816ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60652025-01-30T20:22:30.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60662025-01-30T20:22:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
60672025-01-30T20:22:30.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60682025-01-30T20:22:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60692025-01-30T20:22:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60702025-01-30T20:22:30.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60712025-01-30T20:22:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60722025-01-30T20:22:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
60732025-01-30T20:22:30.819ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60742025-01-30T20:22:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60752025-01-30T20:22:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60762025-01-30T20:22:30.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60772025-01-30T20:22:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60782025-01-30T20:22:30.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60792025-01-30T20:22:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60802025-01-30T20:22:30.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
60812025-01-30T20:22:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60822025-01-30T20:22:30.821ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.072447ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
60832025-01-30T20:22:30.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60842025-01-30T20:22:30.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2502, tv_nsec: 32732136 } })
60852025-01-30T20:22:30.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
60862025-01-30T20:22:30.823ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60872025-01-30T20:22:30.824ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60882025-01-30T20:22:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60892025-01-30T20:22:30.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60902025-01-30T20:22:30.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60912025-01-30T20:22:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60922025-01-30T20:22:30.826ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
60932025-01-30T20:22:30.826ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
60942025-01-30T20:22:30.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
60952025-01-30T20:22:30.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60962025-01-30T20:22:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60972025-01-30T20:22:30.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60982025-01-30T20:22:30.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60992025-01-30T20:22:30.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61002025-01-30T20:22:30.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
61012025-01-30T20:22:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
61022025-01-30T20:22:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61032025-01-30T20:22:30.832ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61042025-01-30T20:22:30.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61052025-01-30T20:22:30.836ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2502, tv_nsec: 45186931 } })
61062025-01-30T20:22:30.836ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
61072025-01-30T20:22:30.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61082025-01-30T20:22:30.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61092025-01-30T20:22:30.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61102025-01-30T20:22:30.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61112025-01-30T20:22:30.839ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61122025-01-30T20:22:30.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61132025-01-30T20:22:30.839ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
61142025-01-30T20:22:30.839ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 37.83661ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
61152025-01-30T20:22:30.841ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61162025-01-30T20:22:30.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61172025-01-30T20:22:30.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61182025-01-30T20:22:30.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61192025-01-30T20:22:30.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61202025-01-30T20:22:30.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61212025-01-30T20:22:30.850ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
61222025-01-30T20:22:30.850ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
61232025-01-30T20:22:30.850ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 48.413783ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
61242025-01-30T20:22:30.850ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61252025-01-30T20:22:30.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61262025-01-30T20:22:30.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61272025-01-30T20:22:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61282025-01-30T20:22:30.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61292025-01-30T20:22:30.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61302025-01-30T20:22:30.861ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61312025-01-30T20:22:30.861ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61322025-01-30T20:22:30.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61332025-01-30T20:22:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61342025-01-30T20:22:30.867ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
61352025-01-30T20:22:30.867ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
61362025-01-30T20:22:30.867ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 66.117056ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
61372025-01-30T20:22:30.871ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
61382025-01-30T20:22:30.871ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
61392025-01-30T20:22:30.871ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
61402025-01-30T20:22:30.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61412025-01-30T20:22:30.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61422025-01-30T20:22:30.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61432025-01-30T20:22:30.876ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61442025-01-30T20:22:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61452025-01-30T20:22:30.878ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61462025-01-30T20:22:30.878ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.438601ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61472025-01-30T20:22:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
61482025-01-30T20:22:30.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61492025-01-30T20:22:30.878ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61502025-01-30T20:22:30.878ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61512025-01-30T20:22:30.878ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
61522025-01-30T20:22:30.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61532025-01-30T20:22:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61542025-01-30T20:22:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61552025-01-30T20:22:30.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61562025-01-30T20:22:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61572025-01-30T20:22:30.950ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
61582025-01-30T20:22:30.985ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
61592025-01-30T20:22:30.985ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61602025-01-30T20:22:30.986ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d250f63-2c0d-4e53-b23b-1c6967e23857", "content-length": "26", "date": "Thu, 30 Jan 2025 20:22:30 GMT"} })
61612025-01-30T20:22:30.986ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61622025-01-30T20:22:30.987ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61632025-01-30T20:22:30.987ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
61642025-01-30T20:22:30.987ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61652025-01-30T20:22:30.987ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3b7bb06-19b4-495f-9b5e-33de1d2f2668", "content-length": "26", "date": "Thu, 30 Jan 2025 20:22:30 GMT"} })
61662025-01-30T20:22:30.987ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61672025-01-30T20:22:30.989ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61682025-01-30T20:22:31.008ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
61692025-01-30T20:22:31.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
61702025-01-30T20:22:31.011ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61712025-01-30T20:22:31.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61722025-01-30T20:22:31.012ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61732025-01-30T20:22:31.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61742025-01-30T20:22:31.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61752025-01-30T20:22:31.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61762025-01-30T20:22:31.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61772025-01-30T20:22:31.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
61782025-01-30T20:22:31.015ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61792025-01-30T20:22:31.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61802025-01-30T20:22:31.017ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 215.380207ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61812025-01-30T20:22:31.017ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 215.905723ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61822025-01-30T20:22:31.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61832025-01-30T20:22:31.018ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61842025-01-30T20:22:31.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61852025-01-30T20:22:31.020ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61862025-01-30T20:22:31.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
61872025-01-30T20:22:31.022ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61882025-01-30T20:22:31.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61892025-01-30T20:22:31.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61902025-01-30T20:22:31.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61912025-01-30T20:22:31.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61922025-01-30T20:22:31.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61932025-01-30T20:22:31.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61942025-01-30T20:22:31.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61952025-01-30T20:22:31.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
61962025-01-30T20:22:31.024ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
61972025-01-30T20:22:31.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
61982025-01-30T20:22:31.027ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
61992025-01-30T20:22:31.027ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 225.15484ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
62002025-01-30T20:22:31.029ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
62012025-01-30T20:22:31.031ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "65d18858-1257-4cb7-9b72-97c7ef5f67f5", "content-length": "2", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} })
62022025-01-30T20:22:31.033ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:619 sled = http://[fd00:1122:3344:101::1]:12345
62032025-01-30T20:22:31.034ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
62042025-01-30T20:22:31.034ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 233.526751ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
62052025-01-30T20:22:31.034ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62062025-01-30T20:22:31.035ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 233.814369ms iteration = 2 status = {"last_run_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":1,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"operation":"list","target_sled":"80be2cf5-c1f1-42e5-8353-289dd0bb621a","time":"2025-01-30T20:22:31.033583776Z"}]}
62072025-01-30T20:22:31.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62082025-01-30T20:22:31.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62092025-01-30T20:22:31.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62102025-01-30T20:22:31.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62112025-01-30T20:22:31.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62122025-01-30T20:22:31.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62132025-01-30T20:22:31.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62142025-01-30T20:22:31.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62152025-01-30T20:22:31.056ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 254.990918ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62162025-01-30T20:22:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
62172025-01-30T20:22:31.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62182025-01-30T20:22:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62192025-01-30T20:22:31.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
62202025-01-30T20:22:31.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62212025-01-30T20:22:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62222025-01-30T20:22:31.059ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62232025-01-30T20:22:31.059ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62242025-01-30T20:22:31.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62252025-01-30T20:22:31.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62262025-01-30T20:22:31.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62272025-01-30T20:22:31.059ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 258.408992ms iteration = 11 status = 0
62282025-01-30T20:22:31.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62292025-01-30T20:22:31.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62302025-01-30T20:22:31.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
62312025-01-30T20:22:31.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62322025-01-30T20:22:31.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62332025-01-30T20:22:31.061ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62342025-01-30T20:22:31.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62352025-01-30T20:22:31.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62362025-01-30T20:22:31.064ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62372025-01-30T20:22:31.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62382025-01-30T20:22:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
62392025-01-30T20:22:31.067ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62402025-01-30T20:22:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62412025-01-30T20:22:31.068ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
62422025-01-30T20:22:31.068ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
62432025-01-30T20:22:31.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62442025-01-30T20:22:31.068ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62452025-01-30T20:22:31.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62462025-01-30T20:22:31.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62472025-01-30T20:22:31.070ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62482025-01-30T20:22:31.070ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
62492025-01-30T20:22:31.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62502025-01-30T20:22:31.070ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62512025-01-30T20:22:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62522025-01-30T20:22:31.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62532025-01-30T20:22:31.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62542025-01-30T20:22:31.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62552025-01-30T20:22:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 272.087481ms iteration = 13 status = {"physical_disks_added":0}
62562025-01-30T20:22:31.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62572025-01-30T20:22:31.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62582025-01-30T20:22:31.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62592025-01-30T20:22:31.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62602025-01-30T20:22:31.075ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62612025-01-30T20:22:31.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62622025-01-30T20:22:31.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62632025-01-30T20:22:31.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62642025-01-30T20:22:31.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62652025-01-30T20:22:31.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62662025-01-30T20:22:31.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62672025-01-30T20:22:31.078ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
62682025-01-30T20:22:31.078ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62692025-01-30T20:22:31.078ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-30 20:18:12.536035 UTC dns_group = internal generation = 1
62702025-01-30T20:22:31.078ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 276.774791ms iteration = 6 status = {"generation":1}
62712025-01-30T20:22:31.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
62722025-01-30T20:22:31.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62732025-01-30T20:22:31.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62742025-01-30T20:22:31.078ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
62752025-01-30T20:22:31.078ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62762025-01-30T20:22:31.078ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-30 20:18:13.133071 UTC dns_group = external generation = 2
62772025-01-30T20:22:31.078ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 276.967227ms iteration = 6 status = {"generation":2}
62782025-01-30T20:22:31.079ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62792025-01-30T20:22:31.081ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62802025-01-30T20:22:31.081ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62812025-01-30T20:22:31.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62822025-01-30T20:22:31.082ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62832025-01-30T20:22:31.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62842025-01-30T20:22:31.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62852025-01-30T20:22:31.084ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62862025-01-30T20:22:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62872025-01-30T20:22:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62882025-01-30T20:22:31.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62892025-01-30T20:22:31.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62902025-01-30T20:22:31.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62912025-01-30T20:22:31.087ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
62922025-01-30T20:22:31.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62932025-01-30T20:22:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62942025-01-30T20:22:31.089ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62952025-01-30T20:22:31.089ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62962025-01-30T20:22:31.089ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 288.111196ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62972025-01-30T20:22:31.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 289.32649ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
62982025-01-30T20:22:31.094ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62992025-01-30T20:22:31.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63002025-01-30T20:22:31.096ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63012025-01-30T20:22:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63022025-01-30T20:22:31.112ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
63032025-01-30T20:22:31.113ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "00aacc42-54de-4ed7-b12c-666a01cdd7ac", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63042025-01-30T20:22:31.113ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63052025-01-30T20:22:31.114ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b5627dcf-2316-4bfe-ac6f-466deabc4f89", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63062025-01-30T20:22:31.114ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63072025-01-30T20:22:31.116ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63082025-01-30T20:22:31.116ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 314.238352ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
63092025-01-30T20:22:31.175ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 373.582079ms iteration = 11 status = {}
63102025-01-30T20:22:31.176ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63112025-01-30T20:22:31.177ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa7749a8-8ebd-4425-88f1-6d2ec474e2fd", "content-length": "1", "date": "Thu, 30 Jan 2025 20:22:30 GMT"} })
63122025-01-30T20:22:31.179ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63132025-01-30T20:22:31.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63142025-01-30T20:22:31.186ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
63152025-01-30T20:22:31.186ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63162025-01-30T20:22:31.186ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7b1084c-5240-4fb6-a1ac-d1f97e58af15", "content-length": "26", "date": "Thu, 30 Jan 2025 20:22:30 GMT"} })
63172025-01-30T20:22:31.186ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63182025-01-30T20:22:31.187ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
63192025-01-30T20:22:31.249ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
63202025-01-30T20:22:31.254ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63212025-01-30T20:22:31.255ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e96b9543-ae3d-4935-9f43-658d75abe6d3", "content-length": "691", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} })
63222025-01-30T20:22:31.255ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
63232025-01-30T20:22:31.255ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
63242025-01-30T20:22:31.255ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
63252025-01-30T20:22:31.258ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 456.600793ms iteration = 11 status = {}
63262025-01-30T20:22:31.258ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63272025-01-30T20:22:31.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63282025-01-30T20:22:31.261ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63292025-01-30T20:22:31.261ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63302025-01-30T20:22:31.262ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ce43152-7880-46ce-b6ad-3af6adf92356", "content-length": "372", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} })
63312025-01-30T20:22:31.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63322025-01-30T20:22:31.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63332025-01-30T20:22:31.276ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 475.24993ms iteration = 11 status = null
63342025-01-30T20:22:31.316ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) }
63352025-01-30T20:22:31.316ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 514.88727ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
63362025-01-30T20:22:31.325ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63372025-01-30T20:22:31.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63382025-01-30T20:22:31.327ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63392025-01-30T20:22:31.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63402025-01-30T20:22:31.331ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
63412025-01-30T20:22:31.332ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c17d898e-ba80-4aab-914c-53ea8bd3aba3", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63422025-01-30T20:22:31.332ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63432025-01-30T20:22:31.335ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "dae30657-6397-43a2-ba95-392e0acd73f4", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63442025-01-30T20:22:31.335ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63452025-01-30T20:22:31.335ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
63462025-01-30T20:22:31.335ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
63472025-01-30T20:22:31.335ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ab769c76-b917-44c6-8100-b724d7f885b3", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} })
63482025-01-30T20:22:31.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63492025-01-30T20:22:31.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63502025-01-30T20:22:31.337ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fc87ef9a-870a-4560-b531-934ac959e7ac", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63512025-01-30T20:22:31.337ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63522025-01-30T20:22:31.339ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
63532025-01-30T20:22:31.339ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 538.486885ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
63542025-01-30T20:22:31.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63552025-01-30T20:22:31.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63562025-01-30T20:22:31.343ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63572025-01-30T20:22:31.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63582025-01-30T20:22:31.347ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
63592025-01-30T20:22:31.347ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63602025-01-30T20:22:31.350ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "37b51b08-a5e5-4ff4-8a92-547639b64e6c", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} })
63612025-01-30T20:22:31.352ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 550.252322ms iteration = 11 status = {}
63622025-01-30T20:22:31.379ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63632025-01-30T20:22:31.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
63642025-01-30T20:22:31.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63652025-01-30T20:22:31.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63662025-01-30T20:22:31.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63672025-01-30T20:22:31.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63682025-01-30T20:22:31.386ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63692025-01-30T20:22:31.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63702025-01-30T20:22:31.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63712025-01-30T20:22:31.388ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63722025-01-30T20:22:31.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63732025-01-30T20:22:31.389ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
63742025-01-30T20:22:31.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63752025-01-30T20:22:31.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63762025-01-30T20:22:31.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63772025-01-30T20:22:31.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63782025-01-30T20:22:31.396ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63792025-01-30T20:22:31.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63802025-01-30T20:22:31.397ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63812025-01-30T20:22:31.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63822025-01-30T20:22:31.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63832025-01-30T20:22:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63842025-01-30T20:22:31.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63852025-01-30T20:22:31.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63862025-01-30T20:22:31.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63872025-01-30T20:22:31.401ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63882025-01-30T20:22:31.403ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
63892025-01-30T20:22:31.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63902025-01-30T20:22:31.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63912025-01-30T20:22:31.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
63922025-01-30T20:22:31.406ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63932025-01-30T20:22:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63942025-01-30T20:22:31.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63952025-01-30T20:22:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63962025-01-30T20:22:31.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63972025-01-30T20:22:31.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63982025-01-30T20:22:31.410ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
63992025-01-30T20:22:31.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64002025-01-30T20:22:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64012025-01-30T20:22:31.418ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64022025-01-30T20:22:31.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64032025-01-30T20:22:31.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64042025-01-30T20:22:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64052025-01-30T20:22:31.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64062025-01-30T20:22:31.430ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64072025-01-30T20:22:31.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64082025-01-30T20:22:31.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64092025-01-30T20:22:31.435ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64102025-01-30T20:22:31.435ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "90f0acc4-f001-40fc-96f4-9ec5bc692433", "content-length": "134", "date": "Thu, 30 Jan 2025 20:22:30 GMT"} })
64112025-01-30T20:22:31.435ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64122025-01-30T20:22:31.435ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
64132025-01-30T20:22:31.436ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64142025-01-30T20:22:31.436ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64152025-01-30T20:22:31.436ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64162025-01-30T20:22:31.436ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64172025-01-30T20:22:31.436ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64182025-01-30T20:22:31.436ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64192025-01-30T20:22:31.436ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64202025-01-30T20:22:31.436ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64212025-01-30T20:22:31.436ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
64222025-01-30T20:22:31.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64232025-01-30T20:22:31.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64242025-01-30T20:22:31.441ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64252025-01-30T20:22:31.441ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1cef2a1-edab-4712-8f1a-2334118b7d47", "content-length": "2", "date": "Thu, 30 Jan 2025 20:22:30 GMT"} })
64262025-01-30T20:22:31.441ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64272025-01-30T20:22:31.441ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "efeb0310-cad1-44f5-862f-ea19cac6a565", "content-length": "52", "date": "Thu, 30 Jan 2025 20:22:30 GMT"} })
64282025-01-30T20:22:31.441ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
64292025-01-30T20:22:31.441ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64302025-01-30T20:22:31.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64312025-01-30T20:22:31.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64322025-01-30T20:22:31.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64332025-01-30T20:22:31.452ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64342025-01-30T20:22:31.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64352025-01-30T20:22:31.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64362025-01-30T20:22:31.468ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64372025-01-30T20:22:31.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64382025-01-30T20:22:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64392025-01-30T20:22:31.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64402025-01-30T20:22:31.472ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
64412025-01-30T20:22:31.472ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64422025-01-30T20:22:31.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64432025-01-30T20:22:31.473ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64442025-01-30T20:22:31.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64452025-01-30T20:22:31.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64462025-01-30T20:22:31.478ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64472025-01-30T20:22:31.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64482025-01-30T20:22:31.480ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64492025-01-30T20:22:31.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64502025-01-30T20:22:31.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64512025-01-30T20:22:31.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64522025-01-30T20:22:31.486ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64532025-01-30T20:22:31.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64542025-01-30T20:22:31.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64552025-01-30T20:22:31.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64562025-01-30T20:22:31.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64572025-01-30T20:22:31.489ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64582025-01-30T20:22:31.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64592025-01-30T20:22:31.490ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64602025-01-30T20:22:31.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64612025-01-30T20:22:31.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64622025-01-30T20:22:31.491ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64632025-01-30T20:22:31.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64642025-01-30T20:22:31.493ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64652025-01-30T20:22:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64662025-01-30T20:22:31.495ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64672025-01-30T20:22:31.499ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
64682025-01-30T20:22:31.499ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64692025-01-30T20:22:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64702025-01-30T20:22:31.500ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64712025-01-30T20:22:31.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64722025-01-30T20:22:31.502ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64732025-01-30T20:22:31.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64742025-01-30T20:22:31.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64752025-01-30T20:22:31.544ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
64762025-01-30T20:22:31.544ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64772025-01-30T20:22:31.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64782025-01-30T20:22:31.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64792025-01-30T20:22:31.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64802025-01-30T20:22:31.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64812025-01-30T20:22:31.551ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
64822025-01-30T20:22:31.551ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64832025-01-30T20:22:31.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64842025-01-30T20:22:31.552ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64852025-01-30T20:22:31.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64862025-01-30T20:22:31.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64872025-01-30T20:22:31.552ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64882025-01-30T20:22:31.555ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
64892025-01-30T20:22:31.555ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64902025-01-30T20:22:31.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64912025-01-30T20:22:31.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64922025-01-30T20:22:31.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64932025-01-30T20:22:31.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64942025-01-30T20:22:31.565ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64952025-01-30T20:22:31.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64962025-01-30T20:22:31.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64972025-01-30T20:22:31.566ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "55c6fd29-4d95-4752-bb8a-eefcae5dbba8", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} })
64982025-01-30T20:22:31.566ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
64992025-01-30T20:22:31.566ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65002025-01-30T20:22:31.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ef63b356-aed3-4e4c-b70c-4b50f5f236e8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65012025-01-30T20:22:31.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ef63b356-aed3-4e4c-b70c-4b50f5f236e8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65022025-01-30T20:22:31.567ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4047b92-b106-4bd5-86e0-7a90d0b41e97", "content-length": "682", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} })
65032025-01-30T20:22:31.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65042025-01-30T20:22:31.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65052025-01-30T20:22:31.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ef63b356-aed3-4e4c-b70c-4b50f5f236e8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65062025-01-30T20:22:31.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65072025-01-30T20:22:31.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65082025-01-30T20:22:31.577ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
65092025-01-30T20:22:31.577ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
65102025-01-30T20:22:31.577ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
65112025-01-30T20:22:31.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65122025-01-30T20:22:31.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65132025-01-30T20:22:31.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65142025-01-30T20:22:31.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65152025-01-30T20:22:31.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65162025-01-30T20:22:31.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65172025-01-30T20:22:31.596ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 794.954163ms iteration = 11 status = {}
65182025-01-30T20:22:31.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65192025-01-30T20:22:31.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65202025-01-30T20:22:31.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65212025-01-30T20:22:31.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65222025-01-30T20:22:31.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65232025-01-30T20:22:31.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65242025-01-30T20:22:31.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65252025-01-30T20:22:31.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65262025-01-30T20:22:31.631ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
65272025-01-30T20:22:31.631ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 829.684517ms iteration = 4 status = {"blueprint_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","inventory_collection_id":"49e495b3-cfc0-4279-9b6d-54bd5c9618d6","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":9,"num_not_in_inventory":0,"num_tombstoned":0}}}
65282025-01-30T20:22:31.641ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, time_created: 2025-01-30T20:18:10.641871Z, time_modified: 2025-01-30T20:18:10.641871Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
65292025-01-30T20:22:31.641ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
65302025-01-30T20:22:31.641ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65312025-01-30T20:22:31.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65322025-01-30T20:22:31.646ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65332025-01-30T20:22:31.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65342025-01-30T20:22:31.651ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65352025-01-30T20:22:31.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
65362025-01-30T20:22:31.691ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
65372025-01-30T20:22:31.691ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "1e9796d2-e60c-4c32-b00d-61ac5244c399", "date": "Thu, 30 Jan 2025 20:22:31 GMT"} })
65382025-01-30T20:22:31.693ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
65392025-01-30T20:22:31.693ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 891.812501ms
65402025-01-30T20:22:31.693ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 891.827152ms iteration = 2 status = {}
65412025-01-30T20:22:32.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = a4bdd364-2990-4076-90a3-e9e668d71e6a roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
65422025-01-30T20:22:32.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = a4bdd364-2990-4076-90a3-e9e668d71e6a resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
65432025-01-30T20:22:32.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = a4bdd364-2990-4076-90a3-e9e668d71e6a response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
65442025-01-30T20:22:32.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = bd56d369-7ceb-4540-924e-cb2a10b19c4f roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
65452025-01-30T20:22:32.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = bd56d369-7ceb-4540-924e-cb2a10b19c4f resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
65462025-01-30T20:22:32.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = bd56d369-7ceb-4540-924e-cb2a10b19c4f response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
65472025-01-30T20:22:32.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 496 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 501638d4-e95d-4161-8bd9-b41e52084ea5 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
65482025-01-30T20:22:32.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 792d921d-faef-467b-a214-6d922bf2a19e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
65492025-01-30T20:22:32.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 792d921d-faef-467b-a214-6d922bf2a19e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
65502025-01-30T20:22:32.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 792d921d-faef-467b-a214-6d922bf2a19e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
65512025-01-30T20:22:32.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 16491122-73ce-4742-9f2a-0bcd4cb56604 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65522025-01-30T20:22:32.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 16491122-73ce-4742-9f2a-0bcd4cb56604 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65532025-01-30T20:22:32.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 16491122-73ce-4742-9f2a-0bcd4cb56604 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65542025-01-30T20:22:33.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = caa22c3b-6e31-4692-8e7d-0138b8c188ba roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65552025-01-30T20:22:33.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = caa22c3b-6e31-4692-8e7d-0138b8c188ba resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65562025-01-30T20:22:33.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = caa22c3b-6e31-4692-8e7d-0138b8c188ba response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65572025-01-30T20:22:34.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6ece6419-64ef-44a1-83bc-469c1acd939f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65582025-01-30T20:22:34.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6ece6419-64ef-44a1-83bc-469c1acd939f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65592025-01-30T20:22:34.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6ece6419-64ef-44a1-83bc-469c1acd939f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65602025-01-30T20:22:35.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3f667866-f050-4e5b-8e03-0aa557311dd6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65612025-01-30T20:22:35.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3f667866-f050-4e5b-8e03-0aa557311dd6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65622025-01-30T20:22:35.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3f667866-f050-4e5b-8e03-0aa557311dd6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65632025-01-30T20:22:36.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 57121318-c0ed-4ec5-90c2-a9d741283ded roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65642025-01-30T20:22:36.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 57121318-c0ed-4ec5-90c2-a9d741283ded resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65652025-01-30T20:22:36.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 57121318-c0ed-4ec5-90c2-a9d741283ded response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65662025-01-30T20:22:37.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 60a24e0a-730c-490f-9900-c82ea2c6ae2f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65672025-01-30T20:22:37.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 60a24e0a-730c-490f-9900-c82ea2c6ae2f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65682025-01-30T20:22:37.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 60a24e0a-730c-490f-9900-c82ea2c6ae2f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65692025-01-30T20:22:38.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a266082f-a6d2-4ae0-9958-b5f31a1f044f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65702025-01-30T20:22:38.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a266082f-a6d2-4ae0-9958-b5f31a1f044f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65712025-01-30T20:22:38.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a266082f-a6d2-4ae0-9958-b5f31a1f044f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65722025-01-30T20:22:39.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = af553e4d-a5a0-4980-b313-7836fbc357f4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65732025-01-30T20:22:39.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = af553e4d-a5a0-4980-b313-7836fbc357f4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65742025-01-30T20:22:39.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = af553e4d-a5a0-4980-b313-7836fbc357f4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65752025-01-30T20:22:40.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c3c98e31-9a1a-40df-a9e0-e2e0acded4af roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65762025-01-30T20:22:40.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c3c98e31-9a1a-40df-a9e0-e2e0acded4af resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65772025-01-30T20:22:40.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c3c98e31-9a1a-40df-a9e0-e2e0acded4af response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
65782025-01-30T20:22:40.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
65792025-01-30T20:22:40.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
65802025-01-30T20:22:40.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65812025-01-30T20:22:40.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65822025-01-30T20:22:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65832025-01-30T20:22:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65842025-01-30T20:22:40.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65852025-01-30T20:22:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65862025-01-30T20:22:40.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65872025-01-30T20:22:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65882025-01-30T20:22:40.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65892025-01-30T20:22:40.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65902025-01-30T20:22:40.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65912025-01-30T20:22:40.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
65922025-01-30T20:22:40.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65932025-01-30T20:22:40.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65942025-01-30T20:22:40.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
65952025-01-30T20:22:40.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.676675ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
65962025-01-30T20:22:40.835ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65972025-01-30T20:22:40.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65982025-01-30T20:22:40.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.390821ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65992025-01-30T20:22:41.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6ddbbf83-e7f3-4279-99a9-93d891080483 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66002025-01-30T20:22:41.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6ddbbf83-e7f3-4279-99a9-93d891080483 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66012025-01-30T20:22:41.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6ddbbf83-e7f3-4279-99a9-93d891080483 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66022025-01-30T20:22:42.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 848 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = d3a04e5a-5e2f-48f8-a8f3-30c2b5950630 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
66032025-01-30T20:22:42.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 421c2476-f0f8-42ad-9ec0-c15ac9762654 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66042025-01-30T20:22:42.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 421c2476-f0f8-42ad-9ec0-c15ac9762654 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66052025-01-30T20:22:42.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 421c2476-f0f8-42ad-9ec0-c15ac9762654 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66062025-01-30T20:22:43.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 136d2d10-8bd7-4533-99df-0e52444eea41 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66072025-01-30T20:22:43.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 136d2d10-8bd7-4533-99df-0e52444eea41 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66082025-01-30T20:22:43.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 136d2d10-8bd7-4533-99df-0e52444eea41 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66092025-01-30T20:22:44.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e729bf5b-d12d-4b6b-8ec9-859e26607463 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66102025-01-30T20:22:44.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e729bf5b-d12d-4b6b-8ec9-859e26607463 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66112025-01-30T20:22:44.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e729bf5b-d12d-4b6b-8ec9-859e26607463 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66122025-01-30T20:22:45.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8c22a99f-79da-4c35-8d8d-66a2e5ec68e0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66132025-01-30T20:22:45.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8c22a99f-79da-4c35-8d8d-66a2e5ec68e0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66142025-01-30T20:22:45.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8c22a99f-79da-4c35-8d8d-66a2e5ec68e0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66152025-01-30T20:22:46.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ff40776-076e-4863-970b-3c253328f047 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66162025-01-30T20:22:46.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ff40776-076e-4863-970b-3c253328f047 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66172025-01-30T20:22:46.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ff40776-076e-4863-970b-3c253328f047 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66182025-01-30T20:22:47.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = a3087e60-b402-473b-a970-31560902d062 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
66192025-01-30T20:22:47.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = a3087e60-b402-473b-a970-31560902d062 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
66202025-01-30T20:22:47.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = a3087e60-b402-473b-a970-31560902d062 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
66212025-01-30T20:22:47.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = 86a569dd-76dc-442f-8245-7d8d85b291a2 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
66222025-01-30T20:22:47.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = 86a569dd-76dc-442f-8245-7d8d85b291a2 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
66232025-01-30T20:22:47.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = 86a569dd-76dc-442f-8245-7d8d85b291a2 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
66242025-01-30T20:22:47.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e4ece261-733a-4aa2-b442-da4aa49c268f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66252025-01-30T20:22:47.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e4ece261-733a-4aa2-b442-da4aa49c268f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66262025-01-30T20:22:47.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e4ece261-733a-4aa2-b442-da4aa49c268f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66272025-01-30T20:22:48.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4bc9c2be-3c18-48e7-a50d-431e729b61fa roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66282025-01-30T20:22:48.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4bc9c2be-3c18-48e7-a50d-431e729b61fa resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66292025-01-30T20:22:48.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4bc9c2be-3c18-48e7-a50d-431e729b61fa response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66302025-01-30T20:22:49.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2227fc61-9b1b-4fd6-9b0c-5cefbe188c67 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66312025-01-30T20:22:49.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2227fc61-9b1b-4fd6-9b0c-5cefbe188c67 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66322025-01-30T20:22:49.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2227fc61-9b1b-4fd6-9b0c-5cefbe188c67 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66332025-01-30T20:22:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
66342025-01-30T20:22:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66352025-01-30T20:22:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
66362025-01-30T20:22:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66372025-01-30T20:22:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66382025-01-30T20:22:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66392025-01-30T20:22:50.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66402025-01-30T20:22:50.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66412025-01-30T20:22:50.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66422025-01-30T20:22:50.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66432025-01-30T20:22:50.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66442025-01-30T20:22:50.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66452025-01-30T20:22:50.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66462025-01-30T20:22:50.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
66472025-01-30T20:22:50.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66482025-01-30T20:22:50.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66492025-01-30T20:22:50.830ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
66502025-01-30T20:22:50.830ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.44615ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
66512025-01-30T20:22:50.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66522025-01-30T20:22:50.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66532025-01-30T20:22:50.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.054798ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66542025-01-30T20:22:51.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2132b645-b90c-49b1-90e3-f7801a020f00 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66552025-01-30T20:22:51.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2132b645-b90c-49b1-90e3-f7801a020f00 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66562025-01-30T20:22:51.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2132b645-b90c-49b1-90e3-f7801a020f00 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66572025-01-30T20:22:52.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e3bc0ae8-b514-4769-93ac-beeeb73f2474 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66582025-01-30T20:22:52.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e3bc0ae8-b514-4769-93ac-beeeb73f2474 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66592025-01-30T20:22:52.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e3bc0ae8-b514-4769-93ac-beeeb73f2474 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66602025-01-30T20:22:52.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 576 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = f984a962-e136-4993-9838-5965b0dec9da response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
66612025-01-30T20:22:53.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0e802343-abf7-49e9-ad46-ce6e75ddfc09 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66622025-01-30T20:22:53.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0e802343-abf7-49e9-ad46-ce6e75ddfc09 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66632025-01-30T20:22:53.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0e802343-abf7-49e9-ad46-ce6e75ddfc09 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66642025-01-30T20:22:54.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d5bd1c33-12f9-4265-b100-ecdeb99fbb4b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66652025-01-30T20:22:54.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d5bd1c33-12f9-4265-b100-ecdeb99fbb4b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66662025-01-30T20:22:54.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d5bd1c33-12f9-4265-b100-ecdeb99fbb4b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66672025-01-30T20:22:55.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8e08aaff-1d4e-42ba-b45c-5df84a975280 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66682025-01-30T20:22:55.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8e08aaff-1d4e-42ba-b45c-5df84a975280 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66692025-01-30T20:22:55.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8e08aaff-1d4e-42ba-b45c-5df84a975280 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66702025-01-30T20:22:56.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df68df41-36e7-450a-8f61-94b7975c12e5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66712025-01-30T20:22:56.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df68df41-36e7-450a-8f61-94b7975c12e5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66722025-01-30T20:22:56.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df68df41-36e7-450a-8f61-94b7975c12e5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66732025-01-30T20:22:57.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4fe98b1c-56da-4456-bf0a-b538a9b898cd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66742025-01-30T20:22:57.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4fe98b1c-56da-4456-bf0a-b538a9b898cd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66752025-01-30T20:22:57.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4fe98b1c-56da-4456-bf0a-b538a9b898cd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66762025-01-30T20:22:58.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 839aead2-779a-410e-9c38-170319acb322 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66772025-01-30T20:22:58.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 839aead2-779a-410e-9c38-170319acb322 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66782025-01-30T20:22:58.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 839aead2-779a-410e-9c38-170319acb322 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66792025-01-30T20:22:59.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d1457be7-14d4-4ada-9869-4f86a1cf2cf3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66802025-01-30T20:22:59.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d1457be7-14d4-4ada-9869-4f86a1cf2cf3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66812025-01-30T20:22:59.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d1457be7-14d4-4ada-9869-4f86a1cf2cf3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66822025-01-30T20:23:00.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 41345fce-0ed7-4b29-8617-8e7f084a6230 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66832025-01-30T20:23:00.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 41345fce-0ed7-4b29-8617-8e7f084a6230 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66842025-01-30T20:23:00.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 41345fce-0ed7-4b29-8617-8e7f084a6230 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
66852025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
66862025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66872025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
66882025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
66892025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66902025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66912025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
66922025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66932025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
66942025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66952025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
66962025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
66972025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66982025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
66992025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67002025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
67012025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
67022025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67032025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
67042025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67052025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
67062025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
67072025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
67082025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67092025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
67102025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67112025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67122025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
67132025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67142025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67152025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
67162025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67172025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
67182025-01-30T20:23:00.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67192025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67202025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
67212025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67222025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67232025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67242025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67252025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67262025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67272025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
67282025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67292025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67302025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67312025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67322025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67332025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67342025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67352025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67362025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67372025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67382025-01-30T20:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67392025-01-30T20:23:00.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67402025-01-30T20:23:00.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67412025-01-30T20:23:00.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67422025-01-30T20:23:00.804ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.213889ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67432025-01-30T20:23:00.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67442025-01-30T20:23:00.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67452025-01-30T20:23:00.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67462025-01-30T20:23:00.806ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67472025-01-30T20:23:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
67482025-01-30T20:23:00.808ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
67492025-01-30T20:23:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
67502025-01-30T20:23:00.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2532, tv_nsec: 19014995 } })
67512025-01-30T20:23:00.810ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
67522025-01-30T20:23:00.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67532025-01-30T20:23:00.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67542025-01-30T20:23:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67552025-01-30T20:23:00.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67562025-01-30T20:23:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67572025-01-30T20:23:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67582025-01-30T20:23:00.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67592025-01-30T20:23:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67602025-01-30T20:23:00.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67612025-01-30T20:23:00.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2532, tv_nsec: 25713091 } })
67622025-01-30T20:23:00.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
67632025-01-30T20:23:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67642025-01-30T20:23:00.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67652025-01-30T20:23:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67662025-01-30T20:23:00.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.99098ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67672025-01-30T20:23:00.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67682025-01-30T20:23:00.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67692025-01-30T20:23:00.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67702025-01-30T20:23:00.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67712025-01-30T20:23:00.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67722025-01-30T20:23:00.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67732025-01-30T20:23:00.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67742025-01-30T20:23:00.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67752025-01-30T20:23:00.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67762025-01-30T20:23:00.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67772025-01-30T20:23:00.850ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67782025-01-30T20:23:00.850ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67792025-01-30T20:23:00.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67802025-01-30T20:23:00.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67812025-01-30T20:23:00.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67822025-01-30T20:23:00.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67832025-01-30T20:23:00.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67842025-01-30T20:23:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67852025-01-30T20:23:00.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67862025-01-30T20:23:00.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67872025-01-30T20:23:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67882025-01-30T20:23:00.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67892025-01-30T20:23:00.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67902025-01-30T20:23:00.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67912025-01-30T20:23:00.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67922025-01-30T20:23:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67932025-01-30T20:23:00.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67942025-01-30T20:23:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67952025-01-30T20:23:00.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.754829ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
67962025-01-30T20:23:00.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67972025-01-30T20:23:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
67982025-01-30T20:23:00.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67992025-01-30T20:23:00.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68002025-01-30T20:23:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68012025-01-30T20:23:00.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.537545ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
68022025-01-30T20:23:00.861ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.5354ms iteration = 12 status = 0
68032025-01-30T20:23:00.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68042025-01-30T20:23:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68052025-01-30T20:23:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
68062025-01-30T20:23:00.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68072025-01-30T20:23:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68082025-01-30T20:23:00.863ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68092025-01-30T20:23:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68102025-01-30T20:23:00.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68112025-01-30T20:23:00.866ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2532, tv_nsec: 75802791 } })
68122025-01-30T20:23:00.866ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
68132025-01-30T20:23:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
68142025-01-30T20:23:00.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68152025-01-30T20:23:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68162025-01-30T20:23:00.871ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68172025-01-30T20:23:00.871ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.737653ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68182025-01-30T20:23:00.876ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
68192025-01-30T20:23:00.876ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68202025-01-30T20:23:00.876ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53afd2a3-9cae-450b-9489-05615332a673", "content-length": "26", "date": "Thu, 30 Jan 2025 20:23:00 GMT"} })
68212025-01-30T20:23:00.876ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68222025-01-30T20:23:00.878ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68232025-01-30T20:23:00.879ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
68242025-01-30T20:23:00.879ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68252025-01-30T20:23:00.879ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98214772-840c-43a7-b49f-dbc708861282", "content-length": "26", "date": "Thu, 30 Jan 2025 20:23:00 GMT"} })
68262025-01-30T20:23:00.879ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68272025-01-30T20:23:00.881ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68282025-01-30T20:23:00.882ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
68292025-01-30T20:23:00.882ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.504972ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
68302025-01-30T20:23:00.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68312025-01-30T20:23:00.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68322025-01-30T20:23:00.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68332025-01-30T20:23:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68342025-01-30T20:23:00.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 87.109407ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
68352025-01-30T20:23:00.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.42465ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68362025-01-30T20:23:00.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.406295ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68372025-01-30T20:23:00.894ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68382025-01-30T20:23:00.894ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68392025-01-30T20:23:00.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68402025-01-30T20:23:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68412025-01-30T20:23:00.902ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68422025-01-30T20:23:00.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
68432025-01-30T20:23:00.904ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68442025-01-30T20:23:00.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68452025-01-30T20:23:00.915ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
68462025-01-30T20:23:00.915ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68472025-01-30T20:23:00.915ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e58a617a-f176-461d-81e8-7aa58ecb90ae", "content-length": "26", "date": "Thu, 30 Jan 2025 20:23:00 GMT"} })
68482025-01-30T20:23:00.915ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68492025-01-30T20:23:00.917ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
68502025-01-30T20:23:00.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68512025-01-30T20:23:00.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68522025-01-30T20:23:00.931ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 130.524432ms iteration = 12 status = {}
68532025-01-30T20:23:00.931ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68542025-01-30T20:23:00.931ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68552025-01-30T20:23:00.931ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.577174ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68562025-01-30T20:23:00.934ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68572025-01-30T20:23:00.934ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "225e53b7-27d9-4cca-864b-289b14d0d62e", "content-length": "1", "date": "Thu, 30 Jan 2025 20:23:00 GMT"} })
68582025-01-30T20:23:00.937ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68592025-01-30T20:23:00.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68602025-01-30T20:23:00.940ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 138.854584ms iteration = 14 status = {"physical_disks_added":0}
68612025-01-30T20:23:00.940ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 139.349138ms iteration = 12 status = null
68622025-01-30T20:23:00.940ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
68632025-01-30T20:23:00.940ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 139.570393ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
68642025-01-30T20:23:01.012ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68652025-01-30T20:23:01.012ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68662025-01-30T20:23:01.013ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a078ff9-cd8c-44fa-b017-4f843b09c800", "content-length": "372", "date": "Thu, 30 Jan 2025 20:23:01 GMT"} })
68672025-01-30T20:23:01.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68682025-01-30T20:23:01.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68692025-01-30T20:23:01.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68702025-01-30T20:23:01.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68712025-01-30T20:23:01.026ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68722025-01-30T20:23:01.027ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
68732025-01-30T20:23:01.027ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68742025-01-30T20:23:01.027ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "de1859b6-061b-4f82-926b-bfbf4d0811fe", "date": "Thu, 30 Jan 2025 20:23:01 GMT"} })
68752025-01-30T20:23:01.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68762025-01-30T20:23:01.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68772025-01-30T20:23:01.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68782025-01-30T20:23:01.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68792025-01-30T20:23:01.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68802025-01-30T20:23:01.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68812025-01-30T20:23:01.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68822025-01-30T20:23:01.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68832025-01-30T20:23:01.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68842025-01-30T20:23:01.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68852025-01-30T20:23:01.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68862025-01-30T20:23:01.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68872025-01-30T20:23:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68882025-01-30T20:23:01.036ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68892025-01-30T20:23:01.036ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68902025-01-30T20:23:01.037ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "baaa80e0-92c6-4db0-8725-4ff512fc2d3f", "date": "Thu, 30 Jan 2025 20:23:01 GMT"} })
68912025-01-30T20:23:01.038ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 236.841473ms iteration = 12 status = {}
68922025-01-30T20:23:01.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68932025-01-30T20:23:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68942025-01-30T20:23:01.071ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
68952025-01-30T20:23:01.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68962025-01-30T20:23:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68972025-01-30T20:23:01.081ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68982025-01-30T20:23:01.081ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a5c4b7a-9064-4559-9826-54462e6d4a40", "content-length": "134", "date": "Thu, 30 Jan 2025 20:23:00 GMT"} })
68992025-01-30T20:23:01.081ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69002025-01-30T20:23:01.081ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
69012025-01-30T20:23:01.082ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69022025-01-30T20:23:01.082ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69032025-01-30T20:23:01.082ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69042025-01-30T20:23:01.082ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69052025-01-30T20:23:01.082ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69062025-01-30T20:23:01.082ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69072025-01-30T20:23:01.082ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69082025-01-30T20:23:01.082ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69092025-01-30T20:23:01.082ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69102025-01-30T20:23:01.082ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b8e3f7d-891e-476b-9d77-639de7fdfecb", "content-length": "691", "date": "Thu, 30 Jan 2025 20:23:01 GMT"} })
69112025-01-30T20:23:01.082ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69122025-01-30T20:23:01.082ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69132025-01-30T20:23:01.082ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69142025-01-30T20:23:01.082ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
69152025-01-30T20:23:01.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69162025-01-30T20:23:01.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69172025-01-30T20:23:01.083ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 282.515511ms iteration = 12 status = {}
69182025-01-30T20:23:01.084ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69192025-01-30T20:23:01.084ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfe76e84-e150-4981-ab43-c3c187b8903d", "content-length": "2", "date": "Thu, 30 Jan 2025 20:23:00 GMT"} })
69202025-01-30T20:23:01.084ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69212025-01-30T20:23:01.084ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4aec2f24-6358-4507-8425-f66100d15e42", "content-length": "52", "date": "Thu, 30 Jan 2025 20:23:00 GMT"} })
69222025-01-30T20:23:01.084ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
69232025-01-30T20:23:01.084ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69242025-01-30T20:23:01.223ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "163a79fb-f293-4c9e-b64b-7904d3db6d94", "date": "Thu, 30 Jan 2025 20:23:01 GMT"} })
69252025-01-30T20:23:01.223ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
69262025-01-30T20:23:01.223ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69272025-01-30T20:23:01.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df439b21-8a0b-46d2-bad8-9e11f28999a8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69282025-01-30T20:23:01.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df439b21-8a0b-46d2-bad8-9e11f28999a8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69292025-01-30T20:23:01.224ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "754163aa-e43e-403c-9a6d-1389a4e1ffe9", "content-length": "682", "date": "Thu, 30 Jan 2025 20:23:01 GMT"} })
69302025-01-30T20:23:01.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69312025-01-30T20:23:01.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69322025-01-30T20:23:01.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df439b21-8a0b-46d2-bad8-9e11f28999a8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69332025-01-30T20:23:01.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69342025-01-30T20:23:01.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69352025-01-30T20:23:01.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69362025-01-30T20:23:01.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69372025-01-30T20:23:01.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69382025-01-30T20:23:01.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69392025-01-30T20:23:01.244ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 443.566781ms iteration = 12 status = {}
69402025-01-30T20:23:02.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 633b5631-e735-46ff-bc76-757698db4ebd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69412025-01-30T20:23:02.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 633b5631-e735-46ff-bc76-757698db4ebd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69422025-01-30T20:23:02.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 633b5631-e735-46ff-bc76-757698db4ebd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69432025-01-30T20:23:02.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = 66760278-0825-45b4-a394-7b8752f44c25 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
69442025-01-30T20:23:02.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = 66760278-0825-45b4-a394-7b8752f44c25 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
69452025-01-30T20:23:02.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = 66760278-0825-45b4-a394-7b8752f44c25 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
69462025-01-30T20:23:02.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = e011c9bf-1366-4f21-995f-78a803977e8f roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
69472025-01-30T20:23:02.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = e011c9bf-1366-4f21-995f-78a803977e8f resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
69482025-01-30T20:23:02.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60718 req_id = e011c9bf-1366-4f21-995f-78a803977e8f response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
69492025-01-30T20:23:02.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 443 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 41625ac0-b06d-4102-9225-9fc59f3bcd04 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
69502025-01-30T20:23:02.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 3be8d409-0bb1-4cb1-9fef-0b067a2ecc81 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
69512025-01-30T20:23:02.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 3be8d409-0bb1-4cb1-9fef-0b067a2ecc81 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
69522025-01-30T20:23:02.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 3be8d409-0bb1-4cb1-9fef-0b067a2ecc81 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
69532025-01-30T20:23:03.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b7e3cfca-068e-4d35-abd8-4bb4b40b8631 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69542025-01-30T20:23:03.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b7e3cfca-068e-4d35-abd8-4bb4b40b8631 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69552025-01-30T20:23:03.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b7e3cfca-068e-4d35-abd8-4bb4b40b8631 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69562025-01-30T20:23:04.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4d3728ed-f5f7-4bb8-a3a9-096bca1955d2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69572025-01-30T20:23:04.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4d3728ed-f5f7-4bb8-a3a9-096bca1955d2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69582025-01-30T20:23:04.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4d3728ed-f5f7-4bb8-a3a9-096bca1955d2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69592025-01-30T20:23:05.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f6a046b4-bef0-4d6b-b901-30093824aac8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69602025-01-30T20:23:05.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f6a046b4-bef0-4d6b-b901-30093824aac8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69612025-01-30T20:23:05.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f6a046b4-bef0-4d6b-b901-30093824aac8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69622025-01-30T20:23:06.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1a7bba16-9b96-4db3-b3dd-13f81739f929 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69632025-01-30T20:23:06.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1a7bba16-9b96-4db3-b3dd-13f81739f929 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69642025-01-30T20:23:06.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1a7bba16-9b96-4db3-b3dd-13f81739f929 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69652025-01-30T20:23:07.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ddcf4fd-d264-411a-8e95-27e792a4e4ae roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69662025-01-30T20:23:07.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ddcf4fd-d264-411a-8e95-27e792a4e4ae resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69672025-01-30T20:23:07.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ddcf4fd-d264-411a-8e95-27e792a4e4ae response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69682025-01-30T20:23:08.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b368c3dd-0ebf-4970-a580-a9d9c1347342 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69692025-01-30T20:23:08.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b368c3dd-0ebf-4970-a580-a9d9c1347342 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69702025-01-30T20:23:08.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b368c3dd-0ebf-4970-a580-a9d9c1347342 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69712025-01-30T20:23:09.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 07965d7d-207c-4570-b504-16f3ffbb3343 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69722025-01-30T20:23:09.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 07965d7d-207c-4570-b504-16f3ffbb3343 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69732025-01-30T20:23:09.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 07965d7d-207c-4570-b504-16f3ffbb3343 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69742025-01-30T20:23:10.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6b41d496-081f-40b0-a6bd-11c298eeef82 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69752025-01-30T20:23:10.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6b41d496-081f-40b0-a6bd-11c298eeef82 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69762025-01-30T20:23:10.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1756 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6b41d496-081f-40b0-a6bd-11c298eeef82 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69772025-01-30T20:23:10.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
69782025-01-30T20:23:10.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
69792025-01-30T20:23:10.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69802025-01-30T20:23:10.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69812025-01-30T20:23:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69822025-01-30T20:23:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69832025-01-30T20:23:10.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69842025-01-30T20:23:10.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69852025-01-30T20:23:10.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69862025-01-30T20:23:10.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69872025-01-30T20:23:10.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69882025-01-30T20:23:10.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69892025-01-30T20:23:10.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69902025-01-30T20:23:10.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
69912025-01-30T20:23:10.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69922025-01-30T20:23:10.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69932025-01-30T20:23:10.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
69942025-01-30T20:23:10.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.182582ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
69952025-01-30T20:23:10.831ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69962025-01-30T20:23:10.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69972025-01-30T20:23:10.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.659808ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69982025-01-30T20:23:11.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = efc2b89c-0c11-4f49-9832-bd4edf09193f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
69992025-01-30T20:23:11.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = efc2b89c-0c11-4f49-9832-bd4edf09193f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70002025-01-30T20:23:11.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = efc2b89c-0c11-4f49-9832-bd4edf09193f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70012025-01-30T20:23:12.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 457 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 1702b109-8dfe-4a96-947d-596e7053074c response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
70022025-01-30T20:23:12.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b09c0e18-6ced-479f-b65c-088e33e4822e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70032025-01-30T20:23:12.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b09c0e18-6ced-479f-b65c-088e33e4822e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70042025-01-30T20:23:12.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b09c0e18-6ced-479f-b65c-088e33e4822e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70052025-01-30T20:23:13.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e368c10d-955f-4fbe-9914-d29178bc48f5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70062025-01-30T20:23:13.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e368c10d-955f-4fbe-9914-d29178bc48f5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70072025-01-30T20:23:13.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e368c10d-955f-4fbe-9914-d29178bc48f5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70082025-01-30T20:23:14.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c930e2d6-d57f-402a-9f3f-88cdb23781c1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70092025-01-30T20:23:14.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c930e2d6-d57f-402a-9f3f-88cdb23781c1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70102025-01-30T20:23:14.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c930e2d6-d57f-402a-9f3f-88cdb23781c1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70112025-01-30T20:23:15.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a2c16c99-3109-4c55-8ffc-bc411ef1516a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70122025-01-30T20:23:15.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a2c16c99-3109-4c55-8ffc-bc411ef1516a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70132025-01-30T20:23:15.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a2c16c99-3109-4c55-8ffc-bc411ef1516a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70142025-01-30T20:23:16.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ecd56b5e-bac2-4acf-ba78-9b5130b7fc07 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70152025-01-30T20:23:16.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ecd56b5e-bac2-4acf-ba78-9b5130b7fc07 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70162025-01-30T20:23:16.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ecd56b5e-bac2-4acf-ba78-9b5130b7fc07 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70172025-01-30T20:23:17.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8b298af4-e71f-4935-9500-d2fa46cdad93 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70182025-01-30T20:23:17.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8b298af4-e71f-4935-9500-d2fa46cdad93 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70192025-01-30T20:23:17.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8b298af4-e71f-4935-9500-d2fa46cdad93 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70202025-01-30T20:23:18.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c5e9aa96-0e0c-4173-a025-c484affdf5fa roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70212025-01-30T20:23:18.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c5e9aa96-0e0c-4173-a025-c484affdf5fa resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70222025-01-30T20:23:18.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c5e9aa96-0e0c-4173-a025-c484affdf5fa response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70232025-01-30T20:23:19.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = daa6224b-c62d-4f69-a130-963ca184c31b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70242025-01-30T20:23:19.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = daa6224b-c62d-4f69-a130-963ca184c31b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70252025-01-30T20:23:19.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = daa6224b-c62d-4f69-a130-963ca184c31b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70262025-01-30T20:23:20.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5beea166-9336-4f57-824f-312ff345ddab roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70272025-01-30T20:23:20.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5beea166-9336-4f57-824f-312ff345ddab resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70282025-01-30T20:23:20.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5beea166-9336-4f57-824f-312ff345ddab response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70292025-01-30T20:23:20.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
70302025-01-30T20:23:20.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
70312025-01-30T20:23:20.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70322025-01-30T20:23:20.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70332025-01-30T20:23:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70342025-01-30T20:23:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70352025-01-30T20:23:20.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70362025-01-30T20:23:20.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70372025-01-30T20:23:20.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70382025-01-30T20:23:20.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70392025-01-30T20:23:20.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70402025-01-30T20:23:20.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70412025-01-30T20:23:20.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70422025-01-30T20:23:20.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70432025-01-30T20:23:20.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70442025-01-30T20:23:20.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
70452025-01-30T20:23:20.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70462025-01-30T20:23:20.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70472025-01-30T20:23:20.820ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
70482025-01-30T20:23:20.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.485281ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
70492025-01-30T20:23:20.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.989148ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70502025-01-30T20:23:21.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f67f8f15-1829-4578-bb41-5c8749780238 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70512025-01-30T20:23:21.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f67f8f15-1829-4578-bb41-5c8749780238 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70522025-01-30T20:23:21.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f67f8f15-1829-4578-bb41-5c8749780238 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70532025-01-30T20:23:22.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 595 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 7047548a-d5b0-4caf-aec5-43719e121b3b response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
70542025-01-30T20:23:22.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2f624bb7-2115-4272-a3e4-64073086cc0b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70552025-01-30T20:23:22.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2f624bb7-2115-4272-a3e4-64073086cc0b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70562025-01-30T20:23:22.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2f624bb7-2115-4272-a3e4-64073086cc0b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70572025-01-30T20:23:23.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ba4bad82-9f3b-4f82-8822-f8d81babe38a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70582025-01-30T20:23:23.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ba4bad82-9f3b-4f82-8822-f8d81babe38a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70592025-01-30T20:23:23.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ba4bad82-9f3b-4f82-8822-f8d81babe38a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70602025-01-30T20:23:24.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8b2a9745-0b4b-4610-91b6-43354ceb53a8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70612025-01-30T20:23:24.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8b2a9745-0b4b-4610-91b6-43354ceb53a8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70622025-01-30T20:23:24.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8b2a9745-0b4b-4610-91b6-43354ceb53a8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70632025-01-30T20:23:25.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9be20057-d58e-47d1-bd41-6b8d9e19fc51 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70642025-01-30T20:23:25.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9be20057-d58e-47d1-bd41-6b8d9e19fc51 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70652025-01-30T20:23:25.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9be20057-d58e-47d1-bd41-6b8d9e19fc51 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70662025-01-30T20:23:26.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6777975e-fcb3-46f9-9e4d-724d967d03de roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70672025-01-30T20:23:26.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6777975e-fcb3-46f9-9e4d-724d967d03de resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70682025-01-30T20:23:26.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6777975e-fcb3-46f9-9e4d-724d967d03de response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70692025-01-30T20:23:27.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a23832d0-aee4-4a6e-90c2-01df6b2e89a7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70702025-01-30T20:23:27.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a23832d0-aee4-4a6e-90c2-01df6b2e89a7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70712025-01-30T20:23:27.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a23832d0-aee4-4a6e-90c2-01df6b2e89a7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70722025-01-30T20:23:28.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a8584bcd-e67d-4877-a266-ccec1b844eed roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70732025-01-30T20:23:28.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a8584bcd-e67d-4877-a266-ccec1b844eed resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70742025-01-30T20:23:28.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a8584bcd-e67d-4877-a266-ccec1b844eed response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70752025-01-30T20:23:29.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2cd5bcd7-08a4-4285-8172-e6b4f6dfefa8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70762025-01-30T20:23:29.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2cd5bcd7-08a4-4285-8172-e6b4f6dfefa8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70772025-01-30T20:23:29.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2cd5bcd7-08a4-4285-8172-e6b4f6dfefa8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
70782025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
70792025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70802025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
70812025-01-30T20:23:30.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:13:30.801127292 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
70822025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
70832025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
70842025-01-30T20:23:30.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
70852025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.34\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
70862025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
70872025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
70882025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
70892025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70902025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70912025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
70922025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
70932025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70942025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
70952025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
70962025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
70972025-01-30T20:23:30.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70982025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70992025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
71002025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71012025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71022025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
71032025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71042025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
71052025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
71062025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71072025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
71082025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
71092025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
71102025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
71112025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71122025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
71132025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
71142025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
71152025-01-30T20:23:30.801ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
71162025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71172025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71182025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71192025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
71202025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
71212025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71222025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
71232025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71242025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
71252025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71262025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
71272025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
71282025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
71292025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71302025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
71312025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71322025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71332025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
71342025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71352025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
71362025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71372025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
71382025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
71392025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71402025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
71412025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71422025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
71432025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71442025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71452025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
71462025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71472025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
71482025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71492025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71502025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71512025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71522025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71532025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71542025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71552025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71562025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71572025-01-30T20:23:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71582025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71592025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71602025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71612025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
71622025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71632025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71642025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71652025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71662025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71672025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71682025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71692025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71702025-01-30T20:23:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2562, tv_nsec: 11896487 } })
71712025-01-30T20:23:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2562, tv_nsec: 11903897 } })
71722025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71732025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71742025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71752025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71762025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71772025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71782025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71792025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
71802025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.113701ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
71812025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71822025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
71832025-01-30T20:23:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.166973ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
71842025-01-30T20:23:30.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71852025-01-30T20:23:30.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71862025-01-30T20:23:30.803ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:13:30.801127292 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
71872025-01-30T20:23:30.803ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.767737ms iteration = 7 status = {"expiration":"2025-01-30T20:13:30.801127292Z","pruned":[]}
71882025-01-30T20:23:30.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71892025-01-30T20:23:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.713653ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71902025-01-30T20:23:30.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71912025-01-30T20:23:30.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2562, tv_nsec: 15615911 } })
71922025-01-30T20:23:30.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71932025-01-30T20:23:30.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
71942025-01-30T20:23:30.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71952025-01-30T20:23:30.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2562, tv_nsec: 16936707 } })
71962025-01-30T20:23:30.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
71972025-01-30T20:23:30.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71982025-01-30T20:23:30.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71992025-01-30T20:23:30.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72002025-01-30T20:23:30.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72012025-01-30T20:23:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72022025-01-30T20:23:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72032025-01-30T20:23:30.814ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72042025-01-30T20:23:30.815ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72052025-01-30T20:23:30.815ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72062025-01-30T20:23:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
72072025-01-30T20:23:30.816ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72082025-01-30T20:23:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72092025-01-30T20:23:30.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72102025-01-30T20:23:30.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72112025-01-30T20:23:30.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72122025-01-30T20:23:30.819ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.856666ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
72132025-01-30T20:23:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72142025-01-30T20:23:30.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72152025-01-30T20:23:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
72162025-01-30T20:23:30.819ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
72172025-01-30T20:23:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72182025-01-30T20:23:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
72192025-01-30T20:23:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72202025-01-30T20:23:30.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72212025-01-30T20:23:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72222025-01-30T20:23:30.822ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72232025-01-30T20:23:30.822ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72242025-01-30T20:23:30.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72252025-01-30T20:23:30.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72262025-01-30T20:23:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72272025-01-30T20:23:30.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72282025-01-30T20:23:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72292025-01-30T20:23:30.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72302025-01-30T20:23:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72312025-01-30T20:23:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72322025-01-30T20:23:30.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72332025-01-30T20:23:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72342025-01-30T20:23:30.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 25.901419ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
72352025-01-30T20:23:30.827ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72362025-01-30T20:23:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72372025-01-30T20:23:30.829ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72382025-01-30T20:23:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72392025-01-30T20:23:30.830ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72402025-01-30T20:23:30.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72412025-01-30T20:23:30.832ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72422025-01-30T20:23:30.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72432025-01-30T20:23:30.832ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72442025-01-30T20:23:30.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72452025-01-30T20:23:30.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72462025-01-30T20:23:30.835ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72472025-01-30T20:23:30.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72482025-01-30T20:23:30.835ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72492025-01-30T20:23:30.836ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2562, tv_nsec: 45984763 } })
72502025-01-30T20:23:30.836ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
72512025-01-30T20:23:30.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72522025-01-30T20:23:30.838ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72532025-01-30T20:23:30.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72542025-01-30T20:23:30.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72552025-01-30T20:23:30.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72562025-01-30T20:23:30.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72572025-01-30T20:23:30.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72582025-01-30T20:23:30.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72592025-01-30T20:23:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72602025-01-30T20:23:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72612025-01-30T20:23:30.847ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 46.548712ms iteration = 4 status = {"nsuccess":5}
72622025-01-30T20:23:30.848ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
72632025-01-30T20:23:30.848ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
72642025-01-30T20:23:30.848ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 46.82504ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
72652025-01-30T20:23:30.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72662025-01-30T20:23:30.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72672025-01-30T20:23:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72682025-01-30T20:23:30.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72692025-01-30T20:23:30.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72702025-01-30T20:23:30.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72712025-01-30T20:23:30.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.588302ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
72722025-01-30T20:23:30.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72732025-01-30T20:23:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72742025-01-30T20:23:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72752025-01-30T20:23:30.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72762025-01-30T20:23:30.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72772025-01-30T20:23:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72782025-01-30T20:23:30.867ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72792025-01-30T20:23:30.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72802025-01-30T20:23:30.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72812025-01-30T20:23:30.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.110551ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72822025-01-30T20:23:30.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 67.965286ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72832025-01-30T20:23:30.869ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72842025-01-30T20:23:30.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72852025-01-30T20:23:30.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72862025-01-30T20:23:30.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72872025-01-30T20:23:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72882025-01-30T20:23:30.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
72892025-01-30T20:23:30.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72902025-01-30T20:23:30.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72912025-01-30T20:23:30.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72922025-01-30T20:23:30.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.245501ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72932025-01-30T20:23:30.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72942025-01-30T20:23:30.878ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
72952025-01-30T20:23:30.878ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
72962025-01-30T20:23:30.878ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.356547ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
72972025-01-30T20:23:30.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72982025-01-30T20:23:30.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 74670094-a364-43f3-b30a-2762851e4491 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
72992025-01-30T20:23:30.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 74670094-a364-43f3-b30a-2762851e4491 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
73002025-01-30T20:23:30.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73012025-01-30T20:23:30.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 74670094-a364-43f3-b30a-2762851e4491 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
73022025-01-30T20:23:30.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73032025-01-30T20:23:30.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73042025-01-30T20:23:30.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73052025-01-30T20:23:30.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73062025-01-30T20:23:30.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
73072025-01-30T20:23:30.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73082025-01-30T20:23:30.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73092025-01-30T20:23:30.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73102025-01-30T20:23:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73112025-01-30T20:23:30.886ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73122025-01-30T20:23:30.886ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.698981ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73132025-01-30T20:23:30.887ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
73142025-01-30T20:23:30.887ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
73152025-01-30T20:23:30.887ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
73162025-01-30T20:23:30.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73172025-01-30T20:23:30.887ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
73182025-01-30T20:23:30.887ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
73192025-01-30T20:23:30.887ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
73202025-01-30T20:23:30.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73212025-01-30T20:23:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73222025-01-30T20:23:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73232025-01-30T20:23:30.887ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73242025-01-30T20:23:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73252025-01-30T20:23:30.888ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73262025-01-30T20:23:30.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73272025-01-30T20:23:30.892ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73282025-01-30T20:23:30.892ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73292025-01-30T20:23:30.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73302025-01-30T20:23:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73312025-01-30T20:23:30.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73322025-01-30T20:23:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73332025-01-30T20:23:30.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73342025-01-30T20:23:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73352025-01-30T20:23:30.898ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
73362025-01-30T20:23:30.899ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.741993ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
73372025-01-30T20:23:30.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73382025-01-30T20:23:30.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73392025-01-30T20:23:30.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73402025-01-30T20:23:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73412025-01-30T20:23:30.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
73422025-01-30T20:23:30.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
73432025-01-30T20:23:30.921ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
73442025-01-30T20:23:30.921ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73452025-01-30T20:23:30.922ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbca01c1-58f7-4ea2-b07d-93f5e1cdb087", "content-length": "26", "date": "Thu, 30 Jan 2025 20:23:30 GMT"} })
73462025-01-30T20:23:30.922ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73472025-01-30T20:23:30.924ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73482025-01-30T20:23:30.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73492025-01-30T20:23:30.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73502025-01-30T20:23:30.933ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
73512025-01-30T20:23:30.950ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
73522025-01-30T20:23:30.951ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
73532025-01-30T20:23:30.951ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73542025-01-30T20:23:30.952ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88912bd9-c197-4744-8389-d39c9a9dd2c5", "content-length": "26", "date": "Thu, 30 Jan 2025 20:23:30 GMT"} })
73552025-01-30T20:23:30.952ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73562025-01-30T20:23:30.953ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73572025-01-30T20:23:30.959ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.159929ms iteration = 15 status = {"physical_disks_added":0}
73582025-01-30T20:23:30.984ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
73592025-01-30T20:23:30.984ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73602025-01-30T20:23:30.984ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5dd2d27-7829-4776-8533-8cbbb5c190e3", "content-length": "26", "date": "Thu, 30 Jan 2025 20:23:30 GMT"} })
73612025-01-30T20:23:30.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73622025-01-30T20:23:30.986ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
73632025-01-30T20:23:31.026ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73642025-01-30T20:23:31.026ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73652025-01-30T20:23:31.026ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "570e180d-6982-4e3d-a864-d3e41e3e15b6", "content-length": "372", "date": "Thu, 30 Jan 2025 20:23:31 GMT"} })
73662025-01-30T20:23:31.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73672025-01-30T20:23:31.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73682025-01-30T20:23:31.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73692025-01-30T20:23:31.029ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73702025-01-30T20:23:31.030ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 229.51953ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
73712025-01-30T20:23:31.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
73722025-01-30T20:23:31.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73732025-01-30T20:23:31.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73742025-01-30T20:23:31.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
73752025-01-30T20:23:31.032ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73762025-01-30T20:23:31.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73772025-01-30T20:23:31.033ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73782025-01-30T20:23:31.035ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
73792025-01-30T20:23:31.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73802025-01-30T20:23:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73812025-01-30T20:23:31.035ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
73822025-01-30T20:23:31.035ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 234.448807ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
73832025-01-30T20:23:31.036ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 234.916469ms iteration = 13 status = 0
73842025-01-30T20:23:31.058ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73852025-01-30T20:23:31.058ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73862025-01-30T20:23:31.058ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 257.288941ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
73872025-01-30T20:23:31.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73882025-01-30T20:23:31.065ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
73892025-01-30T20:23:31.065ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
73902025-01-30T20:23:31.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73912025-01-30T20:23:31.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73922025-01-30T20:23:31.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73932025-01-30T20:23:31.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73942025-01-30T20:23:31.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73952025-01-30T20:23:31.067ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
73962025-01-30T20:23:31.067ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 265.979092ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
73972025-01-30T20:23:31.073ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73982025-01-30T20:23:31.076ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9705359-3d42-4da3-a418-ea40208d3e28", "content-length": "1", "date": "Thu, 30 Jan 2025 20:23:30 GMT"} })
73992025-01-30T20:23:31.078ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74002025-01-30T20:23:31.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74012025-01-30T20:23:31.081ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 280.010782ms iteration = 13 status = null
74022025-01-30T20:23:31.083ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) }
74032025-01-30T20:23:31.083ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 281.908044ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
74042025-01-30T20:23:31.083ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
74052025-01-30T20:23:31.085ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
74062025-01-30T20:23:31.085ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
74072025-01-30T20:23:31.086ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "82ac8dcd-77ad-4190-aabf-f4a6d32a8dae", "date": "Thu, 30 Jan 2025 20:23:31 GMT"} })
74082025-01-30T20:23:31.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74092025-01-30T20:23:31.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74102025-01-30T20:23:31.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74112025-01-30T20:23:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74122025-01-30T20:23:31.089ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 287.784137ms iteration = 13 status = {}
74132025-01-30T20:23:31.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74142025-01-30T20:23:31.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74152025-01-30T20:23:31.093ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74162025-01-30T20:23:31.093ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74172025-01-30T20:23:31.093ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
74182025-01-30T20:23:31.093ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6ec0f57e-9153-49fe-9417-a4431a68b87f", "date": "Thu, 30 Jan 2025 20:23:31 GMT"} })
74192025-01-30T20:23:31.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74202025-01-30T20:23:31.094ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a8a552b9-f9cf-4530-a572-eb999c93f3ac", "date": "Thu, 30 Jan 2025 20:23:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
74212025-01-30T20:23:31.094ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
74222025-01-30T20:23:31.096ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 295.110591ms iteration = 13 status = {}
74232025-01-30T20:23:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74242025-01-30T20:23:31.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74252025-01-30T20:23:31.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74262025-01-30T20:23:31.096ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6a124d7f-1388-459f-afe4-274ac7971858", "date": "Thu, 30 Jan 2025 20:23:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
74272025-01-30T20:23:31.096ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
74282025-01-30T20:23:31.098ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
74292025-01-30T20:23:31.098ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
74302025-01-30T20:23:31.098ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-30 20:18:13.133071 UTC dns_group = external generation = 2
74312025-01-30T20:23:31.098ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 296.824888ms iteration = 7 status = {"generation":2}
74322025-01-30T20:23:31.098ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
74332025-01-30T20:23:31.098ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 297.60434ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
74342025-01-30T20:23:31.107ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
74352025-01-30T20:23:31.107ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
74362025-01-30T20:23:31.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74372025-01-30T20:23:31.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74382025-01-30T20:23:31.109ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74392025-01-30T20:23:31.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
74402025-01-30T20:23:31.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74412025-01-30T20:23:31.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74422025-01-30T20:23:31.119ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
74432025-01-30T20:23:31.119ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
74442025-01-30T20:23:31.119ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-30 20:18:12.536035 UTC dns_group = internal generation = 1
74452025-01-30T20:23:31.119ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 318.093178ms iteration = 7 status = {"generation":1}
74462025-01-30T20:23:31.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74472025-01-30T20:23:31.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74482025-01-30T20:23:31.135ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74492025-01-30T20:23:31.137ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74502025-01-30T20:23:31.137ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74512025-01-30T20:23:31.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74522025-01-30T20:23:31.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74532025-01-30T20:23:31.140ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74542025-01-30T20:23:31.140ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74552025-01-30T20:23:31.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74562025-01-30T20:23:31.156ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
74572025-01-30T20:23:31.157ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3b3c7dc8-71be-44d7-b82c-f72288b6af26", "date": "Thu, 30 Jan 2025 20:23:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
74582025-01-30T20:23:31.157ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
74592025-01-30T20:23:31.158ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4008f4f6-b6a9-45be-a0c5-57167c402801", "date": "Thu, 30 Jan 2025 20:23:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
74602025-01-30T20:23:31.158ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
74612025-01-30T20:23:31.160ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6677fafe-ca2d-4c18-8102-0cea6a6374f1", "date": "Thu, 30 Jan 2025 20:23:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
74622025-01-30T20:23:31.160ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
74632025-01-30T20:23:31.163ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
74642025-01-30T20:23:31.163ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 362.238674ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
74652025-01-30T20:23:31.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74662025-01-30T20:23:31.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74672025-01-30T20:23:31.234ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
74682025-01-30T20:23:31.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74692025-01-30T20:23:31.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74702025-01-30T20:23:31.258ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
74712025-01-30T20:23:31.261ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4861182f-3204-4c18-94b9-947b70104c58", "content-length": "134", "date": "Thu, 30 Jan 2025 20:23:30 GMT"} })
74722025-01-30T20:23:31.261ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
74732025-01-30T20:23:31.261ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
74742025-01-30T20:23:31.261ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
74752025-01-30T20:23:31.261ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74762025-01-30T20:23:31.261ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74772025-01-30T20:23:31.261ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74782025-01-30T20:23:31.261ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74792025-01-30T20:23:31.262ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74802025-01-30T20:23:31.262ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74812025-01-30T20:23:31.262ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74822025-01-30T20:23:31.262ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
74832025-01-30T20:23:31.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74842025-01-30T20:23:31.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74852025-01-30T20:23:31.275ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74862025-01-30T20:23:31.275ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcafd148-6e2d-4517-b848-c802f5e2256f", "content-length": "2", "date": "Thu, 30 Jan 2025 20:23:30 GMT"} })
74872025-01-30T20:23:31.275ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74882025-01-30T20:23:31.275ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6cecb6c-6dcc-4799-a6ab-fe792de78ea4", "content-length": "52", "date": "Thu, 30 Jan 2025 20:23:30 GMT"} })
74892025-01-30T20:23:31.275ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
74902025-01-30T20:23:31.275ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74912025-01-30T20:23:31.292ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74922025-01-30T20:23:31.406ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "069ad8ed-605e-4911-a701-b9f5381f1c7b", "date": "Thu, 30 Jan 2025 20:23:31 GMT"} })
74932025-01-30T20:23:31.406ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
74942025-01-30T20:23:31.406ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74952025-01-30T20:23:31.407ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4ed64a8-fb22-420a-8a67-38c90b96862c", "content-length": "691", "date": "Thu, 30 Jan 2025 20:23:31 GMT"} })
74962025-01-30T20:23:31.407ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
74972025-01-30T20:23:31.407ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
74982025-01-30T20:23:31.407ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
74992025-01-30T20:23:31.407ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "322a0b64-fc48-4089-bf88-5cc1fbc2a4c5", "content-length": "682", "date": "Thu, 30 Jan 2025 20:23:31 GMT"} })
75002025-01-30T20:23:31.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75012025-01-30T20:23:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75022025-01-30T20:23:31.408ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 607.214913ms iteration = 13 status = {}
75032025-01-30T20:23:31.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75042025-01-30T20:23:31.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75052025-01-30T20:23:31.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75062025-01-30T20:23:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75072025-01-30T20:23:31.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75082025-01-30T20:23:31.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75092025-01-30T20:23:31.427ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 625.83897ms iteration = 13 status = {}
75102025-01-30T20:23:31.460ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
75112025-01-30T20:23:31.460ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
75122025-01-30T20:23:31.490ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
75132025-01-30T20:23:31.490ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:65262
75142025-01-30T20:23:31.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65262 req_id = cd2e1b96-22dc-4365-89ad-2584645b8ddf roles = RoleSet { roles: {} } uri = /metrics/producers
75152025-01-30T20:23:31.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65262 req_id = cd2e1b96-22dc-4365-89ad-2584645b8ddf resource = Database result = Ok(()) uri = /metrics/producers
75162025-01-30T20:23:31.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = f828408a-b727-44b1-9862-c0f4f73b8661 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
75172025-01-30T20:23:31.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = f828408a-b727-44b1-9862-c0f4f73b8661 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
75182025-01-30T20:23:31.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = f828408a-b727-44b1-9862-c0f4f73b8661 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
75192025-01-30T20:23:31.539ZINFOnexus: assigned collector to new producer collector_id = 623434f7-1950-4ff8-a21d-872e401e4248 file = nexus/src/app/oximeter.rs:76 producer_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
75202025-01-30T20:23:31.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48245 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65262 req_id = cd2e1b96-22dc-4365-89ad-2584645b8ddf response_code = 201 uri = /metrics/producers
75212025-01-30T20:23:31.539ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "cd2e1b96-22dc-4365-89ad-2584645b8ddf", "content-length": "41", "date": "Thu, 30 Jan 2025 20:23:31 GMT"} })
75222025-01-30T20:23:31.541ZDEBGnexus (producer-registration-task): registered with nexus successfully
75232025-01-30T20:23:31.541ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
75242025-01-30T20:23:31.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0221644c-6ecd-4782-9303-4c731ff16427 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75252025-01-30T20:23:31.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0221644c-6ecd-4782-9303-4c731ff16427 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75262025-01-30T20:23:31.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0221644c-6ecd-4782-9303-4c731ff16427 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75272025-01-30T20:23:32.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 499 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = e43ef059-5452-4349-8b6b-93b84332d2bb response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
75282025-01-30T20:23:32.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3bfcfef8-e9ad-4712-9b51-527d6768347c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75292025-01-30T20:23:32.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3bfcfef8-e9ad-4712-9b51-527d6768347c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75302025-01-30T20:23:32.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3bfcfef8-e9ad-4712-9b51-527d6768347c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75312025-01-30T20:23:33.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f03b0256-a2ac-42d8-94b0-ad086b1e02ed roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75322025-01-30T20:23:33.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f03b0256-a2ac-42d8-94b0-ad086b1e02ed resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75332025-01-30T20:23:33.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f03b0256-a2ac-42d8-94b0-ad086b1e02ed response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75342025-01-30T20:23:34.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a42dcf9f-bcf0-4864-98b5-537e649f084b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75352025-01-30T20:23:34.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a42dcf9f-bcf0-4864-98b5-537e649f084b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75362025-01-30T20:23:34.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a42dcf9f-bcf0-4864-98b5-537e649f084b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75372025-01-30T20:23:35.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 46c7a44b-c5b4-4b43-93da-d82e623ef94a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75382025-01-30T20:23:35.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 46c7a44b-c5b4-4b43-93da-d82e623ef94a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75392025-01-30T20:23:35.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 46c7a44b-c5b4-4b43-93da-d82e623ef94a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75402025-01-30T20:23:37.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d46ffa5e-193e-4b2b-8f6f-deef831f83fb roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75412025-01-30T20:23:37.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d46ffa5e-193e-4b2b-8f6f-deef831f83fb resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75422025-01-30T20:23:37.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d46ffa5e-193e-4b2b-8f6f-deef831f83fb response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75432025-01-30T20:23:38.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4b245768-d98b-42c5-9f24-af8e48a17796 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75442025-01-30T20:23:38.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4b245768-d98b-42c5-9f24-af8e48a17796 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75452025-01-30T20:23:38.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4b245768-d98b-42c5-9f24-af8e48a17796 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75462025-01-30T20:23:39.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f2701801-efaf-4105-8b6c-af721499d0a4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75472025-01-30T20:23:39.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f2701801-efaf-4105-8b6c-af721499d0a4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75482025-01-30T20:23:39.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f2701801-efaf-4105-8b6c-af721499d0a4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75492025-01-30T20:23:40.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8eda57cd-0df0-42ab-ab87-8c37c2c63104 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75502025-01-30T20:23:40.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8eda57cd-0df0-42ab-ab87-8c37c2c63104 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75512025-01-30T20:23:40.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8eda57cd-0df0-42ab-ab87-8c37c2c63104 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75522025-01-30T20:23:40.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
75532025-01-30T20:23:40.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
75542025-01-30T20:23:40.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75552025-01-30T20:23:40.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75562025-01-30T20:23:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75572025-01-30T20:23:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75582025-01-30T20:23:40.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75592025-01-30T20:23:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75602025-01-30T20:23:40.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75612025-01-30T20:23:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75622025-01-30T20:23:40.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75632025-01-30T20:23:40.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75642025-01-30T20:23:40.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75652025-01-30T20:23:40.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
75662025-01-30T20:23:40.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75672025-01-30T20:23:40.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75682025-01-30T20:23:40.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
75692025-01-30T20:23:40.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.078901ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
75702025-01-30T20:23:40.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75712025-01-30T20:23:40.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75722025-01-30T20:23:40.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.532429ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75732025-01-30T20:23:41.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7ed75092-6a10-4626-8479-76c7f28df6ae roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75742025-01-30T20:23:41.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7ed75092-6a10-4626-8479-76c7f28df6ae resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75752025-01-30T20:23:41.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7ed75092-6a10-4626-8479-76c7f28df6ae response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75762025-01-30T20:23:42.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7a2da899-0d13-4e8e-ac28-44249c1a40d7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75772025-01-30T20:23:42.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7a2da899-0d13-4e8e-ac28-44249c1a40d7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75782025-01-30T20:23:42.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7a2da899-0d13-4e8e-ac28-44249c1a40d7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75792025-01-30T20:23:42.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 456 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = e46ab402-6c57-4f8e-8277-44b29ff3a83b response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
75802025-01-30T20:23:43.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 578c2406-3397-47b7-a1ee-69ab8e868687 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75812025-01-30T20:23:43.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 578c2406-3397-47b7-a1ee-69ab8e868687 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75822025-01-30T20:23:43.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 578c2406-3397-47b7-a1ee-69ab8e868687 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75832025-01-30T20:23:44.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0688678f-fae5-4f43-b3f0-772d61b2ec36 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75842025-01-30T20:23:44.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0688678f-fae5-4f43-b3f0-772d61b2ec36 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75852025-01-30T20:23:44.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0688678f-fae5-4f43-b3f0-772d61b2ec36 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75862025-01-30T20:23:45.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2f78f084-ede1-41a5-b0af-570be1313bb3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75872025-01-30T20:23:45.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2f78f084-ede1-41a5-b0af-570be1313bb3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75882025-01-30T20:23:45.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2f78f084-ede1-41a5-b0af-570be1313bb3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75892025-01-30T20:23:46.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5fbf2d68-d8c2-4edc-9f04-eea0382ec64d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75902025-01-30T20:23:46.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5fbf2d68-d8c2-4edc-9f04-eea0382ec64d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75912025-01-30T20:23:46.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5fbf2d68-d8c2-4edc-9f04-eea0382ec64d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75922025-01-30T20:23:47.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5247aebc-fcd2-4520-91f4-81f9f98f7d2d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75932025-01-30T20:23:47.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5247aebc-fcd2-4520-91f4-81f9f98f7d2d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75942025-01-30T20:23:47.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5247aebc-fcd2-4520-91f4-81f9f98f7d2d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75952025-01-30T20:23:48.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e4615d6a-b463-47b6-bc13-79553ab12181 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75962025-01-30T20:23:48.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e4615d6a-b463-47b6-bc13-79553ab12181 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75972025-01-30T20:23:48.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e4615d6a-b463-47b6-bc13-79553ab12181 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75982025-01-30T20:23:49.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 50ea274e-6c09-49b7-b962-e5ae30d8da0b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
75992025-01-30T20:23:49.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 50ea274e-6c09-49b7-b962-e5ae30d8da0b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76002025-01-30T20:23:49.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 50ea274e-6c09-49b7-b962-e5ae30d8da0b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76012025-01-30T20:23:50.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 75f7bfd0-2b27-4a05-9d0f-ca1834317403 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76022025-01-30T20:23:50.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 75f7bfd0-2b27-4a05-9d0f-ca1834317403 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76032025-01-30T20:23:50.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 75f7bfd0-2b27-4a05-9d0f-ca1834317403 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76042025-01-30T20:23:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
76052025-01-30T20:23:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76062025-01-30T20:23:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
76072025-01-30T20:23:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76082025-01-30T20:23:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76092025-01-30T20:23:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76102025-01-30T20:23:50.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76112025-01-30T20:23:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76122025-01-30T20:23:50.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76132025-01-30T20:23:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76142025-01-30T20:23:50.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76152025-01-30T20:23:50.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76162025-01-30T20:23:50.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76172025-01-30T20:23:50.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
76182025-01-30T20:23:50.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76192025-01-30T20:23:50.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76202025-01-30T20:23:50.827ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
76212025-01-30T20:23:50.828ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.256098ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
76222025-01-30T20:23:50.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76232025-01-30T20:23:50.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76242025-01-30T20:23:50.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.849487ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76252025-01-30T20:23:51.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 68da8fac-0a62-4590-9660-a4c2b7d1b641 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76262025-01-30T20:23:51.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 68da8fac-0a62-4590-9660-a4c2b7d1b641 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76272025-01-30T20:23:51.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 68da8fac-0a62-4590-9660-a4c2b7d1b641 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76282025-01-30T20:23:52.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 067404fe-75e5-430e-9f63-56a64c65c0c6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76292025-01-30T20:23:52.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 067404fe-75e5-430e-9f63-56a64c65c0c6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76302025-01-30T20:23:52.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 067404fe-75e5-430e-9f63-56a64c65c0c6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76312025-01-30T20:23:52.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 467 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = c541fc54-1bb8-407d-8c08-776d8f09c584 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
76322025-01-30T20:23:53.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f13aaaab-e0f3-48da-b8f0-ff3a8e4058e4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76332025-01-30T20:23:53.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f13aaaab-e0f3-48da-b8f0-ff3a8e4058e4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76342025-01-30T20:23:53.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f13aaaab-e0f3-48da-b8f0-ff3a8e4058e4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76352025-01-30T20:23:54.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4945d48a-e7a8-4a9e-b612-7e29ebcfbb53 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76362025-01-30T20:23:54.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4945d48a-e7a8-4a9e-b612-7e29ebcfbb53 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76372025-01-30T20:23:54.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4945d48a-e7a8-4a9e-b612-7e29ebcfbb53 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76382025-01-30T20:23:55.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 88b7e173-a306-4446-a371-027eab7a05d3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76392025-01-30T20:23:55.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 88b7e173-a306-4446-a371-027eab7a05d3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76402025-01-30T20:23:55.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 88b7e173-a306-4446-a371-027eab7a05d3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76412025-01-30T20:23:56.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c23766ff-cca2-4f54-81b0-46022d9d7799 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76422025-01-30T20:23:56.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c23766ff-cca2-4f54-81b0-46022d9d7799 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76432025-01-30T20:23:56.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c23766ff-cca2-4f54-81b0-46022d9d7799 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76442025-01-30T20:23:57.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7d08f1e7-2c05-4eee-8e29-335a14f99a68 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76452025-01-30T20:23:57.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7d08f1e7-2c05-4eee-8e29-335a14f99a68 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76462025-01-30T20:23:57.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7d08f1e7-2c05-4eee-8e29-335a14f99a68 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76472025-01-30T20:23:58.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 372b491b-95e1-49f0-a8dd-a463f8d45bb8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76482025-01-30T20:23:58.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 372b491b-95e1-49f0-a8dd-a463f8d45bb8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76492025-01-30T20:23:58.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 372b491b-95e1-49f0-a8dd-a463f8d45bb8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76502025-01-30T20:23:59.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 61fbaddb-f02f-4b8a-bfcd-c62ee9ac6e81 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76512025-01-30T20:23:59.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 61fbaddb-f02f-4b8a-bfcd-c62ee9ac6e81 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76522025-01-30T20:23:59.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 61fbaddb-f02f-4b8a-bfcd-c62ee9ac6e81 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76532025-01-30T20:24:00.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d53667ae-0abe-4284-bc70-7bbcc3cc95d0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76542025-01-30T20:24:00.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d53667ae-0abe-4284-bc70-7bbcc3cc95d0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76552025-01-30T20:24:00.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d53667ae-0abe-4284-bc70-7bbcc3cc95d0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
76562025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
76572025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
76582025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
76592025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76602025-01-30T20:24:00.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76612025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76622025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
76632025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76642025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76652025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76662025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
76672025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76682025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
76692025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76702025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
76712025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76722025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
76732025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
76742025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76752025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
76762025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
76772025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76782025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76792025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
76802025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
76812025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76822025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76832025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
76842025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76852025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
76862025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
76872025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76882025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
76892025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76902025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76912025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
76922025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76932025-01-30T20:24:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76942025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76952025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76962025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76972025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76982025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76992025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77002025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77012025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
77022025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77032025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
77042025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77052025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77062025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77072025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77082025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77092025-01-30T20:24:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77102025-01-30T20:24:00.803ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77112025-01-30T20:24:00.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77122025-01-30T20:24:00.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77132025-01-30T20:24:00.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77142025-01-30T20:24:00.804ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.421705ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
77152025-01-30T20:24:00.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
77162025-01-30T20:24:00.805ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
77172025-01-30T20:24:00.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
77182025-01-30T20:24:00.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77192025-01-30T20:24:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
77202025-01-30T20:24:00.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77212025-01-30T20:24:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77222025-01-30T20:24:00.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77232025-01-30T20:24:00.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77242025-01-30T20:24:00.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77252025-01-30T20:24:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77262025-01-30T20:24:00.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.671961ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
77272025-01-30T20:24:00.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77282025-01-30T20:24:00.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77292025-01-30T20:24:00.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2592, tv_nsec: 20982600 } })
77302025-01-30T20:24:00.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
77312025-01-30T20:24:00.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77322025-01-30T20:24:00.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77332025-01-30T20:24:00.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77342025-01-30T20:24:00.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77352025-01-30T20:24:00.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77362025-01-30T20:24:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77372025-01-30T20:24:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77382025-01-30T20:24:00.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77392025-01-30T20:24:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77402025-01-30T20:24:00.817ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77412025-01-30T20:24:00.817ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77422025-01-30T20:24:00.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77432025-01-30T20:24:00.817ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2592, tv_nsec: 27399958 } })
77442025-01-30T20:24:00.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77452025-01-30T20:24:00.817ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
77462025-01-30T20:24:00.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77472025-01-30T20:24:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77482025-01-30T20:24:00.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77492025-01-30T20:24:00.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77502025-01-30T20:24:00.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2592, tv_nsec: 31196543 } })
77512025-01-30T20:24:00.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
77522025-01-30T20:24:00.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77532025-01-30T20:24:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77542025-01-30T20:24:00.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77552025-01-30T20:24:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77562025-01-30T20:24:00.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77572025-01-30T20:24:00.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77582025-01-30T20:24:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77592025-01-30T20:24:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77602025-01-30T20:24:00.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77612025-01-30T20:24:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77622025-01-30T20:24:00.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77632025-01-30T20:24:00.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77642025-01-30T20:24:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77652025-01-30T20:24:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77662025-01-30T20:24:00.863ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
77672025-01-30T20:24:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
77682025-01-30T20:24:00.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77692025-01-30T20:24:00.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77702025-01-30T20:24:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77712025-01-30T20:24:00.864ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77722025-01-30T20:24:00.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.494233ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
77732025-01-30T20:24:00.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77742025-01-30T20:24:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77752025-01-30T20:24:00.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77762025-01-30T20:24:00.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77772025-01-30T20:24:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77782025-01-30T20:24:00.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.621313ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77792025-01-30T20:24:00.866ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77802025-01-30T20:24:00.866ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77812025-01-30T20:24:00.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77822025-01-30T20:24:00.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77832025-01-30T20:24:00.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.795926ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77842025-01-30T20:24:00.867ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77852025-01-30T20:24:00.867ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.927599ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77862025-01-30T20:24:00.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
77872025-01-30T20:24:00.867ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
77882025-01-30T20:24:00.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
77892025-01-30T20:24:00.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77902025-01-30T20:24:00.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77912025-01-30T20:24:00.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77922025-01-30T20:24:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
77932025-01-30T20:24:00.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77942025-01-30T20:24:00.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77952025-01-30T20:24:00.873ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 72.213714ms iteration = 16 status = {"physical_disks_added":0}
77962025-01-30T20:24:00.880ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77972025-01-30T20:24:00.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77982025-01-30T20:24:00.883ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
77992025-01-30T20:24:00.883ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.395547ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
78002025-01-30T20:24:00.889ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.429275ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78012025-01-30T20:24:00.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78022025-01-30T20:24:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
78032025-01-30T20:24:00.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78042025-01-30T20:24:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78052025-01-30T20:24:00.897ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.57287ms iteration = 14 status = 0
78062025-01-30T20:24:00.906ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78072025-01-30T20:24:00.906ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78082025-01-30T20:24:00.906ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.110947ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78092025-01-30T20:24:00.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 109.401887ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
78102025-01-30T20:24:00.912ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
78112025-01-30T20:24:00.912ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 111.175676ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
78122025-01-30T20:24:00.920ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
78132025-01-30T20:24:00.920ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78142025-01-30T20:24:00.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78152025-01-30T20:24:00.920ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d178ab0-498c-438e-97bd-382b392115db", "content-length": "26", "date": "Thu, 30 Jan 2025 20:24:00 GMT"} })
78162025-01-30T20:24:00.920ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78172025-01-30T20:24:00.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78182025-01-30T20:24:00.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78192025-01-30T20:24:00.967ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
78202025-01-30T20:24:00.967ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78212025-01-30T20:24:00.967ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa1f4680-9a11-4404-8d45-b6bfcea04339", "content-length": "26", "date": "Thu, 30 Jan 2025 20:24:00 GMT"} })
78222025-01-30T20:24:00.967ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78232025-01-30T20:24:00.969ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78242025-01-30T20:24:01.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78252025-01-30T20:24:01.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78262025-01-30T20:24:01.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78272025-01-30T20:24:01.012ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
78282025-01-30T20:24:01.012ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78292025-01-30T20:24:01.012ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41845513-256a-4428-9fa7-e2e641da5a08", "content-length": "26", "date": "Thu, 30 Jan 2025 20:24:00 GMT"} })
78302025-01-30T20:24:01.012ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78312025-01-30T20:24:01.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78322025-01-30T20:24:01.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78332025-01-30T20:24:01.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78342025-01-30T20:24:01.014ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
78352025-01-30T20:24:01.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78362025-01-30T20:24:01.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78372025-01-30T20:24:01.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78382025-01-30T20:24:01.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78392025-01-30T20:24:01.042ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78402025-01-30T20:24:01.042ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b24b145f-caa8-4b67-9121-62a692a730c5", "content-length": "1", "date": "Thu, 30 Jan 2025 20:24:00 GMT"} })
78412025-01-30T20:24:01.043ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78422025-01-30T20:24:01.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78432025-01-30T20:24:01.045ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 243.92485ms iteration = 14 status = null
78442025-01-30T20:24:01.056ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
78452025-01-30T20:24:01.056ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78462025-01-30T20:24:01.057ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5122bcd8-fd15-45f6-98a2-6b9609995a3a", "content-length": "372", "date": "Thu, 30 Jan 2025 20:24:01 GMT"} })
78472025-01-30T20:24:01.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78482025-01-30T20:24:01.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78492025-01-30T20:24:01.071ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
78502025-01-30T20:24:01.071ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78512025-01-30T20:24:01.071ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b7aaa6a2-3a38-464e-a14a-262f7ac1d0cf", "date": "Thu, 30 Jan 2025 20:24:01 GMT"} })
78522025-01-30T20:24:01.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78532025-01-30T20:24:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78542025-01-30T20:24:01.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78552025-01-30T20:24:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78562025-01-30T20:24:01.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78572025-01-30T20:24:01.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78582025-01-30T20:24:01.079ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78592025-01-30T20:24:01.079ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78602025-01-30T20:24:01.079ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9902c015-fbc4-47c2-8a3e-8d25266d1242", "date": "Thu, 30 Jan 2025 20:24:01 GMT"} })
78612025-01-30T20:24:01.081ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 279.654272ms iteration = 14 status = {}
78622025-01-30T20:24:01.147ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 346.472636ms iteration = 14 status = {}
78632025-01-30T20:24:01.168ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78642025-01-30T20:24:01.168ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "73fed93e-918d-4e1e-a2c5-7bce9ecccd4a", "content-length": "691", "date": "Thu, 30 Jan 2025 20:24:01 GMT"} })
78652025-01-30T20:24:01.168ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
78662025-01-30T20:24:01.168ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
78672025-01-30T20:24:01.168ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
78682025-01-30T20:24:01.169ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 368.284322ms iteration = 14 status = {}
78692025-01-30T20:24:01.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78702025-01-30T20:24:01.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78712025-01-30T20:24:01.241ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
78722025-01-30T20:24:01.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78732025-01-30T20:24:01.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78742025-01-30T20:24:01.254ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78752025-01-30T20:24:01.254ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b13ef91-1de4-4524-ba78-bed80950f8f3", "content-length": "134", "date": "Thu, 30 Jan 2025 20:24:00 GMT"} })
78762025-01-30T20:24:01.254ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
78772025-01-30T20:24:01.254ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
78782025-01-30T20:24:01.255ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
78792025-01-30T20:24:01.255ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78802025-01-30T20:24:01.255ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78812025-01-30T20:24:01.255ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78822025-01-30T20:24:01.255ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78832025-01-30T20:24:01.255ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78842025-01-30T20:24:01.255ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78852025-01-30T20:24:01.255ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78862025-01-30T20:24:01.255ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
78872025-01-30T20:24:01.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78882025-01-30T20:24:01.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78892025-01-30T20:24:01.262ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78902025-01-30T20:24:01.262ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c32ec45-1617-449b-acf1-ebe301362c09", "content-length": "2", "date": "Thu, 30 Jan 2025 20:24:00 GMT"} })
78912025-01-30T20:24:01.262ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78922025-01-30T20:24:01.262ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f620ae42-59a3-4d65-bd28-d169574632b7", "content-length": "52", "date": "Thu, 30 Jan 2025 20:24:00 GMT"} })
78932025-01-30T20:24:01.262ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
78942025-01-30T20:24:01.262ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78952025-01-30T20:24:01.394ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e2a90115-1f3c-41bf-850b-d3bf0ae8bb04", "date": "Thu, 30 Jan 2025 20:24:01 GMT"} })
78962025-01-30T20:24:01.394ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
78972025-01-30T20:24:01.394ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78982025-01-30T20:24:01.394ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "82384366-c631-4610-b6cf-1db502e925b5", "content-length": "682", "date": "Thu, 30 Jan 2025 20:24:01 GMT"} })
78992025-01-30T20:24:01.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79002025-01-30T20:24:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79012025-01-30T20:24:01.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79022025-01-30T20:24:01.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79032025-01-30T20:24:01.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79042025-01-30T20:24:01.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79052025-01-30T20:24:01.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79062025-01-30T20:24:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79072025-01-30T20:24:01.412ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 611.06963ms iteration = 14 status = {}
79082025-01-30T20:24:01.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = e4e5fb93-86f6-4f21-bb2b-df2dc038f977 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
79092025-01-30T20:24:01.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = e4e5fb93-86f6-4f21-bb2b-df2dc038f977 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
79102025-01-30T20:24:01.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = e4e5fb93-86f6-4f21-bb2b-df2dc038f977 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
79112025-01-30T20:24:01.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = aac003d6-6c5a-417d-bfbe-d91607346aaa roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79122025-01-30T20:24:01.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = aac003d6-6c5a-417d-bfbe-d91607346aaa resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79132025-01-30T20:24:01.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = aac003d6-6c5a-417d-bfbe-d91607346aaa response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79142025-01-30T20:24:02.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = f35a8b8b-f33a-46a3-8f63-2f94a2d5602e response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
79152025-01-30T20:24:02.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31839b07-a698-489d-b894-fce0c3831d7f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79162025-01-30T20:24:02.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31839b07-a698-489d-b894-fce0c3831d7f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79172025-01-30T20:24:02.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31839b07-a698-489d-b894-fce0c3831d7f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79182025-01-30T20:24:03.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e5be0c49-f1af-47a5-9bb5-0d92f1f05efc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79192025-01-30T20:24:03.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e5be0c49-f1af-47a5-9bb5-0d92f1f05efc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79202025-01-30T20:24:03.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e5be0c49-f1af-47a5-9bb5-0d92f1f05efc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79212025-01-30T20:24:04.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5004f5b6-6283-42a8-81cf-601784c3249c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79222025-01-30T20:24:04.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5004f5b6-6283-42a8-81cf-601784c3249c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79232025-01-30T20:24:04.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5004f5b6-6283-42a8-81cf-601784c3249c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79242025-01-30T20:24:05.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 187bedc4-13e9-46b9-9a3d-bf36d7bcf9e5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79252025-01-30T20:24:05.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 187bedc4-13e9-46b9-9a3d-bf36d7bcf9e5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79262025-01-30T20:24:05.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 187bedc4-13e9-46b9-9a3d-bf36d7bcf9e5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79272025-01-30T20:24:06.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c80620ce-fef7-4628-8c98-b39a88927208 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79282025-01-30T20:24:06.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c80620ce-fef7-4628-8c98-b39a88927208 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79292025-01-30T20:24:06.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c80620ce-fef7-4628-8c98-b39a88927208 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79302025-01-30T20:24:07.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3a2b6424-db8c-45a0-b8f0-69c7c1e39a08 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79312025-01-30T20:24:07.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3a2b6424-db8c-45a0-b8f0-69c7c1e39a08 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79322025-01-30T20:24:07.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3a2b6424-db8c-45a0-b8f0-69c7c1e39a08 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79332025-01-30T20:24:08.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a4e80314-766b-4028-93cf-de5d14d8fa00 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79342025-01-30T20:24:08.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a4e80314-766b-4028-93cf-de5d14d8fa00 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79352025-01-30T20:24:08.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a4e80314-766b-4028-93cf-de5d14d8fa00 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79362025-01-30T20:24:09.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b9f6f32a-efc4-461f-afbc-363f98c1d9b2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79372025-01-30T20:24:09.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b9f6f32a-efc4-461f-afbc-363f98c1d9b2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79382025-01-30T20:24:09.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b9f6f32a-efc4-461f-afbc-363f98c1d9b2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79392025-01-30T20:24:10.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c52d25dd-5575-4186-b4c5-b9a628fa3bfc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79402025-01-30T20:24:10.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c52d25dd-5575-4186-b4c5-b9a628fa3bfc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79412025-01-30T20:24:10.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2749 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c52d25dd-5575-4186-b4c5-b9a628fa3bfc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79422025-01-30T20:24:10.800ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
79432025-01-30T20:24:10.800ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
79442025-01-30T20:24:10.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79452025-01-30T20:24:10.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79462025-01-30T20:24:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79472025-01-30T20:24:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79482025-01-30T20:24:10.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79492025-01-30T20:24:10.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79502025-01-30T20:24:10.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79512025-01-30T20:24:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79522025-01-30T20:24:10.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79532025-01-30T20:24:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79542025-01-30T20:24:10.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79552025-01-30T20:24:10.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79562025-01-30T20:24:10.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79572025-01-30T20:24:10.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
79582025-01-30T20:24:10.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79592025-01-30T20:24:10.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79602025-01-30T20:24:10.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
79612025-01-30T20:24:10.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.346056ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
79622025-01-30T20:24:10.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.457511ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79632025-01-30T20:24:11.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 43bcdab3-8d1d-4794-947c-9deceee7fab8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79642025-01-30T20:24:11.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 43bcdab3-8d1d-4794-947c-9deceee7fab8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79652025-01-30T20:24:11.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 43bcdab3-8d1d-4794-947c-9deceee7fab8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79662025-01-30T20:24:12.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 561 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 0eea8523-43ce-468f-84e4-fe4f7a07093c response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
79672025-01-30T20:24:12.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 382952c9-2ed2-40bb-bc26-6775ac1d360d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79682025-01-30T20:24:12.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 382952c9-2ed2-40bb-bc26-6775ac1d360d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79692025-01-30T20:24:12.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 382952c9-2ed2-40bb-bc26-6775ac1d360d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79702025-01-30T20:24:13.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0138f3bc-e7fd-4ab5-b3af-c85c5a9f7e2c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79712025-01-30T20:24:13.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0138f3bc-e7fd-4ab5-b3af-c85c5a9f7e2c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79722025-01-30T20:24:13.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0138f3bc-e7fd-4ab5-b3af-c85c5a9f7e2c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79732025-01-30T20:24:14.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8bccc6d9-57c8-4cb4-b620-e56de3a4c33a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79742025-01-30T20:24:14.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8bccc6d9-57c8-4cb4-b620-e56de3a4c33a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79752025-01-30T20:24:14.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8bccc6d9-57c8-4cb4-b620-e56de3a4c33a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79762025-01-30T20:24:15.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5c09b521-73ff-4202-9487-f6bae3882d96 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79772025-01-30T20:24:15.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5c09b521-73ff-4202-9487-f6bae3882d96 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79782025-01-30T20:24:15.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5c09b521-73ff-4202-9487-f6bae3882d96 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79792025-01-30T20:24:16.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 13eca49f-6e17-4cd5-941b-18c2f7d948ce roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79802025-01-30T20:24:16.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 13eca49f-6e17-4cd5-941b-18c2f7d948ce resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79812025-01-30T20:24:16.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 13eca49f-6e17-4cd5-941b-18c2f7d948ce response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79822025-01-30T20:24:17.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1f09f429-7324-49c7-b82b-1e9692a82153 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79832025-01-30T20:24:17.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1f09f429-7324-49c7-b82b-1e9692a82153 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79842025-01-30T20:24:17.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1f09f429-7324-49c7-b82b-1e9692a82153 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79852025-01-30T20:24:18.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6b363569-be87-4e6c-84b4-37e9e556022b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79862025-01-30T20:24:18.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6b363569-be87-4e6c-84b4-37e9e556022b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79872025-01-30T20:24:18.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6b363569-be87-4e6c-84b4-37e9e556022b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79882025-01-30T20:24:19.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 940ede31-b8a2-42fb-af97-c75d97e80426 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79892025-01-30T20:24:19.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 940ede31-b8a2-42fb-af97-c75d97e80426 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79902025-01-30T20:24:19.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 940ede31-b8a2-42fb-af97-c75d97e80426 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
79912025-01-30T20:24:20.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
79922025-01-30T20:24:20.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79932025-01-30T20:24:20.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
79942025-01-30T20:24:20.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79952025-01-30T20:24:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79962025-01-30T20:24:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79972025-01-30T20:24:20.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79982025-01-30T20:24:20.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79992025-01-30T20:24:20.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80002025-01-30T20:24:20.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.272339ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80012025-01-30T20:24:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80022025-01-30T20:24:20.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80032025-01-30T20:24:20.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80042025-01-30T20:24:20.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80052025-01-30T20:24:20.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80062025-01-30T20:24:20.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80072025-01-30T20:24:20.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
80082025-01-30T20:24:20.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80092025-01-30T20:24:20.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80102025-01-30T20:24:20.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
80112025-01-30T20:24:20.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.90743ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
80122025-01-30T20:24:21.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 20b24d36-7385-4986-8a68-9f2b8b8b161c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80132025-01-30T20:24:21.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 20b24d36-7385-4986-8a68-9f2b8b8b161c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80142025-01-30T20:24:21.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 20b24d36-7385-4986-8a68-9f2b8b8b161c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80152025-01-30T20:24:22.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e9d5ef90-9711-4183-827d-7dbc0b59cc7b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80162025-01-30T20:24:22.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e9d5ef90-9711-4183-827d-7dbc0b59cc7b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80172025-01-30T20:24:22.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e9d5ef90-9711-4183-827d-7dbc0b59cc7b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80182025-01-30T20:24:22.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 555 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = bc1683a1-2739-4346-a0a8-4fb142aea77b response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
80192025-01-30T20:24:23.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c0f5d92e-cc41-4f64-a542-685eaacd74e3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80202025-01-30T20:24:23.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c0f5d92e-cc41-4f64-a542-685eaacd74e3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80212025-01-30T20:24:23.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c0f5d92e-cc41-4f64-a542-685eaacd74e3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80222025-01-30T20:24:24.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = edae58ec-301a-408c-ae91-67eeb8f7035a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80232025-01-30T20:24:24.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = edae58ec-301a-408c-ae91-67eeb8f7035a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80242025-01-30T20:24:24.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = edae58ec-301a-408c-ae91-67eeb8f7035a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80252025-01-30T20:24:25.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0453bcde-dca2-4469-abaa-f9238d881a4b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80262025-01-30T20:24:25.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0453bcde-dca2-4469-abaa-f9238d881a4b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80272025-01-30T20:24:25.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0453bcde-dca2-4469-abaa-f9238d881a4b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80282025-01-30T20:24:26.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b45d0825-7b9d-492a-a416-84eeccecdea0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80292025-01-30T20:24:26.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b45d0825-7b9d-492a-a416-84eeccecdea0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80302025-01-30T20:24:26.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b45d0825-7b9d-492a-a416-84eeccecdea0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80312025-01-30T20:24:27.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df8b8424-3062-44e2-adac-8327c249f054 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80322025-01-30T20:24:27.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df8b8424-3062-44e2-adac-8327c249f054 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80332025-01-30T20:24:27.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df8b8424-3062-44e2-adac-8327c249f054 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80342025-01-30T20:24:28.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f2f58980-6761-4a26-a5bd-b9e37a382fbf roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80352025-01-30T20:24:28.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f2f58980-6761-4a26-a5bd-b9e37a382fbf resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80362025-01-30T20:24:28.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f2f58980-6761-4a26-a5bd-b9e37a382fbf response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80372025-01-30T20:24:29.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 81320a00-e725-4a1c-96be-af33b66b69f5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80382025-01-30T20:24:29.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 81320a00-e725-4a1c-96be-af33b66b69f5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80392025-01-30T20:24:29.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 81320a00-e725-4a1c-96be-af33b66b69f5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80402025-01-30T20:24:30.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e3620d9e-06e3-4270-bcbe-70e486f77842 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80412025-01-30T20:24:30.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e3620d9e-06e3-4270-bcbe-70e486f77842 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80422025-01-30T20:24:30.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e3620d9e-06e3-4270-bcbe-70e486f77842 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
80432025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
80442025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
80452025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80462025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
80472025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80482025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
80492025-01-30T20:24:30.801ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
80502025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
80512025-01-30T20:24:30.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
80522025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80532025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.761\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
80542025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
80552025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
80562025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
80572025-01-30T20:24:30.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:14:30.801212884 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
80582025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80592025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
80602025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
80612025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
80622025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80632025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
80642025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80652025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
80662025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
80672025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
80682025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
80692025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80702025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80712025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80722025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
80732025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80742025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
80752025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80762025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
80772025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
80782025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80792025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
80802025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80812025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
80822025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
80832025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
80842025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80852025-01-30T20:24:30.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80862025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
80872025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80882025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80892025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
80902025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80912025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
80922025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
80932025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
80942025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
80952025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80962025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
80972025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
80982025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
80992025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81002025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
81012025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
81022025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
81032025-01-30T20:24:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
81042025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81052025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
81062025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81072025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81082025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81092025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81102025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
81112025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
81122025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81132025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
81142025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
81152025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81162025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
81172025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
81182025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81192025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81202025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81212025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81222025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81232025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81242025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81252025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81262025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81272025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
81282025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
81292025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81302025-01-30T20:24:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2622, tv_nsec: 12042581 } })
81312025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81322025-01-30T20:24:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2622, tv_nsec: 12061852 } })
81332025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
81342025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
81352025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.620445ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
81362025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
81372025-01-30T20:24:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.44957ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
81382025-01-30T20:24:30.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81392025-01-30T20:24:30.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81402025-01-30T20:24:30.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81412025-01-30T20:24:30.804ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.487637ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
81422025-01-30T20:24:30.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81432025-01-30T20:24:30.804ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81442025-01-30T20:24:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.70415ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
81452025-01-30T20:24:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81462025-01-30T20:24:30.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81472025-01-30T20:24:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81482025-01-30T20:24:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
81492025-01-30T20:24:30.807ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
81502025-01-30T20:24:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
81512025-01-30T20:24:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
81522025-01-30T20:24:30.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81532025-01-30T20:24:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81542025-01-30T20:24:30.808ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:14:30.801212884 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
81552025-01-30T20:24:30.808ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.301373ms iteration = 8 status = {"expiration":"2025-01-30T20:14:30.801212884Z","pruned":[]}
81562025-01-30T20:24:30.810ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81572025-01-30T20:24:30.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2622, tv_nsec: 20613750 } })
81582025-01-30T20:24:30.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
81592025-01-30T20:24:30.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
81602025-01-30T20:24:30.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2622, tv_nsec: 21161005 } })
81612025-01-30T20:24:30.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
81622025-01-30T20:24:30.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
81632025-01-30T20:24:30.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81642025-01-30T20:24:30.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81652025-01-30T20:24:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
81662025-01-30T20:24:30.812ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
81672025-01-30T20:24:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
81682025-01-30T20:24:30.814ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81692025-01-30T20:24:30.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81702025-01-30T20:24:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81712025-01-30T20:24:30.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81722025-01-30T20:24:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81732025-01-30T20:24:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81742025-01-30T20:24:30.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81752025-01-30T20:24:30.817ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81762025-01-30T20:24:30.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81772025-01-30T20:24:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
81782025-01-30T20:24:30.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81792025-01-30T20:24:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81802025-01-30T20:24:30.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81812025-01-30T20:24:30.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81822025-01-30T20:24:30.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
81832025-01-30T20:24:30.821ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81842025-01-30T20:24:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81852025-01-30T20:24:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
81862025-01-30T20:24:30.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81872025-01-30T20:24:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81882025-01-30T20:24:30.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81892025-01-30T20:24:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81902025-01-30T20:24:30.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81912025-01-30T20:24:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81922025-01-30T20:24:30.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81932025-01-30T20:24:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81942025-01-30T20:24:30.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81952025-01-30T20:24:30.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81962025-01-30T20:24:30.831ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
81972025-01-30T20:24:30.831ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
81982025-01-30T20:24:30.831ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
81992025-01-30T20:24:30.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82002025-01-30T20:24:30.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82012025-01-30T20:24:30.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82022025-01-30T20:24:30.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82032025-01-30T20:24:30.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82042025-01-30T20:24:30.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82052025-01-30T20:24:30.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82062025-01-30T20:24:30.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82072025-01-30T20:24:30.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82082025-01-30T20:24:30.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82092025-01-30T20:24:30.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82102025-01-30T20:24:30.846ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2622, tv_nsec: 55759975 } })
82112025-01-30T20:24:30.846ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
82122025-01-30T20:24:30.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82132025-01-30T20:24:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82142025-01-30T20:24:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
82152025-01-30T20:24:30.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82162025-01-30T20:24:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82172025-01-30T20:24:30.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82182025-01-30T20:24:30.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82192025-01-30T20:24:30.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82202025-01-30T20:24:30.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82212025-01-30T20:24:30.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82222025-01-30T20:24:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82232025-01-30T20:24:30.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82242025-01-30T20:24:30.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82252025-01-30T20:24:30.860ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82262025-01-30T20:24:30.860ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
82272025-01-30T20:24:30.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82282025-01-30T20:24:30.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82292025-01-30T20:24:30.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82302025-01-30T20:24:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82312025-01-30T20:24:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82322025-01-30T20:24:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82332025-01-30T20:24:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82342025-01-30T20:24:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82352025-01-30T20:24:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82362025-01-30T20:24:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
82372025-01-30T20:24:30.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82382025-01-30T20:24:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82392025-01-30T20:24:30.865ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82402025-01-30T20:24:30.865ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82412025-01-30T20:24:30.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82422025-01-30T20:24:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82432025-01-30T20:24:30.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 64.682655ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82442025-01-30T20:24:30.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.770771ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82452025-01-30T20:24:30.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.791665ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
82462025-01-30T20:24:30.873ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
82472025-01-30T20:24:30.873ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
82482025-01-30T20:24:30.873ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.519825ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
82492025-01-30T20:24:30.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.568917ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
82502025-01-30T20:24:30.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82512025-01-30T20:24:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82522025-01-30T20:24:30.880ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82532025-01-30T20:24:30.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82542025-01-30T20:24:30.881ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
82552025-01-30T20:24:30.881ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
82562025-01-30T20:24:30.881ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.399731ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
82572025-01-30T20:24:30.881ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
82582025-01-30T20:24:30.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
82592025-01-30T20:24:30.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82602025-01-30T20:24:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82612025-01-30T20:24:30.883ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82622025-01-30T20:24:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
82632025-01-30T20:24:30.887ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
82642025-01-30T20:24:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
82652025-01-30T20:24:30.888ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
82662025-01-30T20:24:30.888ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.532019ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
82672025-01-30T20:24:30.891ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
82682025-01-30T20:24:30.891ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.412759ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
82692025-01-30T20:24:30.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.054926ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82702025-01-30T20:24:30.912ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82712025-01-30T20:24:30.912ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
82722025-01-30T20:24:30.912ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.787765ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
82732025-01-30T20:24:30.913ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
82742025-01-30T20:24:30.913ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
82752025-01-30T20:24:30.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82762025-01-30T20:24:30.913ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
82772025-01-30T20:24:30.913ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
82782025-01-30T20:24:30.913ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
82792025-01-30T20:24:30.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82802025-01-30T20:24:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82812025-01-30T20:24:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82822025-01-30T20:24:30.914ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82832025-01-30T20:24:30.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82842025-01-30T20:24:30.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82852025-01-30T20:24:30.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82862025-01-30T20:24:30.918ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82872025-01-30T20:24:30.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82882025-01-30T20:24:30.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82892025-01-30T20:24:30.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82902025-01-30T20:24:30.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82912025-01-30T20:24:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82922025-01-30T20:24:30.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82932025-01-30T20:24:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82942025-01-30T20:24:30.920ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
82952025-01-30T20:24:30.920ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 119.648011ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
82962025-01-30T20:24:30.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 119.914238ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
82972025-01-30T20:24:30.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82982025-01-30T20:24:30.923ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
82992025-01-30T20:24:30.923ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
83002025-01-30T20:24:30.923ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-30 20:18:12.536035 UTC dns_group = internal generation = 1
83012025-01-30T20:24:30.923ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 121.916484ms iteration = 8 status = {"generation":1}
83022025-01-30T20:24:30.923ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
83032025-01-30T20:24:30.923ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
83042025-01-30T20:24:30.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83052025-01-30T20:24:30.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83062025-01-30T20:24:30.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
83072025-01-30T20:24:30.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83082025-01-30T20:24:30.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83092025-01-30T20:24:30.926ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 125.684428ms iteration = 15 status = 0
83102025-01-30T20:24:30.946ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
83112025-01-30T20:24:30.946ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 144.955823ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
83122025-01-30T20:24:30.947ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
83132025-01-30T20:24:30.954ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
83142025-01-30T20:24:30.957ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83152025-01-30T20:24:30.959ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
83162025-01-30T20:24:30.959ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83172025-01-30T20:24:30.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83182025-01-30T20:24:30.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83192025-01-30T20:24:30.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83202025-01-30T20:24:30.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83212025-01-30T20:24:30.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83222025-01-30T20:24:30.967ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
83232025-01-30T20:24:30.967ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
83242025-01-30T20:24:30.967ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-30 20:18:13.133071 UTC dns_group = external generation = 2
83252025-01-30T20:24:30.967ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 166.085349ms iteration = 8 status = {"generation":2}
83262025-01-30T20:24:30.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83272025-01-30T20:24:30.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83282025-01-30T20:24:30.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83292025-01-30T20:24:30.977ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
83302025-01-30T20:24:30.977ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83312025-01-30T20:24:30.977ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "abc5cd9e-2de3-4589-9151-0526efc48ef8", "content-length": "26", "date": "Thu, 30 Jan 2025 20:24:30 GMT"} })
83322025-01-30T20:24:30.977ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83332025-01-30T20:24:30.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83342025-01-30T20:24:30.978ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83352025-01-30T20:24:30.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83362025-01-30T20:24:30.979ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 177.468766ms iteration = 17 status = {"physical_disks_added":0}
83372025-01-30T20:24:30.980ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83382025-01-30T20:24:31.009ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) }
83392025-01-30T20:24:31.009ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 207.510599ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
83402025-01-30T20:24:31.050ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
83412025-01-30T20:24:31.050ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83422025-01-30T20:24:31.050ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f875f236-87a5-4e37-9fa7-f0d079291f0f", "content-length": "26", "date": "Thu, 30 Jan 2025 20:24:30 GMT"} })
83432025-01-30T20:24:31.050ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83442025-01-30T20:24:31.052ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83452025-01-30T20:24:31.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
83462025-01-30T20:24:31.112ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83472025-01-30T20:24:31.112ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de19d4eb-7f8d-47a8-b659-26b703dc5ad4", "content-length": "26", "date": "Thu, 30 Jan 2025 20:24:30 GMT"} })
83482025-01-30T20:24:31.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83492025-01-30T20:24:31.114ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
83502025-01-30T20:24:31.120ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
83512025-01-30T20:24:31.120ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "58bb89f1-b68e-4966-a563-b47a80efb6cd", "date": "Thu, 30 Jan 2025 20:24:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83522025-01-30T20:24:31.120ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83532025-01-30T20:24:31.121ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7adaaffd-e1e7-4d4b-9928-084d060bdd25", "date": "Thu, 30 Jan 2025 20:24:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83542025-01-30T20:24:31.121ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83552025-01-30T20:24:31.123ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
83562025-01-30T20:24:31.123ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83572025-01-30T20:24:31.123ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 321.677208ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
83582025-01-30T20:24:31.222ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 420.85226ms iteration = 15 status = {}
83592025-01-30T20:24:31.224ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
83602025-01-30T20:24:31.224ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83612025-01-30T20:24:31.225ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b88401f0-1809-4861-bd13-7a6d2bbb1ad0", "content-length": "372", "date": "Thu, 30 Jan 2025 20:24:31 GMT"} })
83622025-01-30T20:24:31.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83632025-01-30T20:24:31.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83642025-01-30T20:24:31.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e5c35eb3-6ca0-440d-9725-7eeb74f4631f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
83652025-01-30T20:24:31.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e5c35eb3-6ca0-440d-9725-7eeb74f4631f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
83662025-01-30T20:24:31.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e5c35eb3-6ca0-440d-9725-7eeb74f4631f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
83672025-01-30T20:24:31.248ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
83682025-01-30T20:24:31.249ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "67b90d10-1c99-4e64-b005-391e8cf31f09", "content-length": "1", "date": "Thu, 30 Jan 2025 20:24:30 GMT"} })
83692025-01-30T20:24:31.251ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83702025-01-30T20:24:31.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83712025-01-30T20:24:31.254ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 453.384363ms iteration = 15 status = null
83722025-01-30T20:24:31.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83732025-01-30T20:24:31.276ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83742025-01-30T20:24:31.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83752025-01-30T20:24:31.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83762025-01-30T20:24:31.277ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
83772025-01-30T20:24:31.277ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0d1b3068-a130-48b4-8367-8922b8b886b5", "date": "Thu, 30 Jan 2025 20:24:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
83782025-01-30T20:24:31.277ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
83792025-01-30T20:24:31.279ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "efcaf44b-b5a2-4423-ab6c-d87aeecfcb7b", "date": "Thu, 30 Jan 2025 20:24:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
83802025-01-30T20:24:31.279ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
83812025-01-30T20:24:31.281ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "21a3cd1a-6cb9-4215-94d7-677fff501eb2", "date": "Thu, 30 Jan 2025 20:24:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
83822025-01-30T20:24:31.281ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
83832025-01-30T20:24:31.283ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
83842025-01-30T20:24:31.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 482.342318ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
83852025-01-30T20:24:31.291ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
83862025-01-30T20:24:31.291ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83872025-01-30T20:24:31.292ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a258cadf-83bb-4f37-bcb6-42fa2d899bb8", "date": "Thu, 30 Jan 2025 20:24:31 GMT"} })
83882025-01-30T20:24:31.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83892025-01-30T20:24:31.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83902025-01-30T20:24:31.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83912025-01-30T20:24:31.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83922025-01-30T20:24:31.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83932025-01-30T20:24:31.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83942025-01-30T20:24:31.303ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
83952025-01-30T20:24:31.303ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83962025-01-30T20:24:31.303ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "820890ab-52d3-44f3-abcb-10913e0a9250", "date": "Thu, 30 Jan 2025 20:24:31 GMT"} })
83972025-01-30T20:24:31.305ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 503.920826ms iteration = 15 status = {}
83982025-01-30T20:24:31.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83992025-01-30T20:24:31.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84002025-01-30T20:24:31.383ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84012025-01-30T20:24:31.384ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0978b92e-aff5-469c-a6c9-5a6baeac0cf8", "content-length": "691", "date": "Thu, 30 Jan 2025 20:24:31 GMT"} })
84022025-01-30T20:24:31.384ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
84032025-01-30T20:24:31.384ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
84042025-01-30T20:24:31.384ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
84052025-01-30T20:24:31.384ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 582.874898ms iteration = 15 status = {}
84062025-01-30T20:24:31.385ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
84072025-01-30T20:24:31.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84082025-01-30T20:24:31.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84092025-01-30T20:24:31.398ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
84102025-01-30T20:24:31.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2397ab54-22e6-4e80-b729-d14585e7b644", "content-length": "134", "date": "Thu, 30 Jan 2025 20:24:30 GMT"} })
84112025-01-30T20:24:31.399ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
84122025-01-30T20:24:31.399ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
84132025-01-30T20:24:31.399ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
84142025-01-30T20:24:31.399ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
84152025-01-30T20:24:31.399ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84162025-01-30T20:24:31.399ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84172025-01-30T20:24:31.399ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84182025-01-30T20:24:31.399ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84192025-01-30T20:24:31.399ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84202025-01-30T20:24:31.399ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84212025-01-30T20:24:31.400ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
84222025-01-30T20:24:31.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84232025-01-30T20:24:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84242025-01-30T20:24:31.402ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
84252025-01-30T20:24:31.402ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "263e5753-0fcb-49fa-be47-9474f9d4c069", "content-length": "2", "date": "Thu, 30 Jan 2025 20:24:30 GMT"} })
84262025-01-30T20:24:31.402ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
84272025-01-30T20:24:31.402ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "69ad2708-1a93-4f04-b0d7-a4864e6506ea", "content-length": "52", "date": "Thu, 30 Jan 2025 20:24:31 GMT"} })
84282025-01-30T20:24:31.402ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
84292025-01-30T20:24:31.402ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
84302025-01-30T20:24:31.526ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "71a4065b-1d26-4cf1-a4b9-591da9cc8e79", "date": "Thu, 30 Jan 2025 20:24:31 GMT"} })
84312025-01-30T20:24:31.526ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
84322025-01-30T20:24:31.526ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
84332025-01-30T20:24:31.527ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c633bfd-6959-4e45-9eb2-0dcce62ecabf", "content-length": "682", "date": "Thu, 30 Jan 2025 20:24:31 GMT"} })
84342025-01-30T20:24:31.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84352025-01-30T20:24:31.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84362025-01-30T20:24:31.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84372025-01-30T20:24:31.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84382025-01-30T20:24:31.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84392025-01-30T20:24:31.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84402025-01-30T20:24:31.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84412025-01-30T20:24:31.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84422025-01-30T20:24:31.550ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 749.260245ms iteration = 15 status = {}
84432025-01-30T20:24:31.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = f118869c-8035-4d51-864f-62663535f9b9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
84442025-01-30T20:24:31.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = f118869c-8035-4d51-864f-62663535f9b9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
84452025-01-30T20:24:31.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = f118869c-8035-4d51-864f-62663535f9b9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
84462025-01-30T20:24:32.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f3aeee7b-7747-4df7-9eff-c32a681c6d60 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84472025-01-30T20:24:32.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f3aeee7b-7747-4df7-9eff-c32a681c6d60 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84482025-01-30T20:24:32.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f3aeee7b-7747-4df7-9eff-c32a681c6d60 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84492025-01-30T20:24:32.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 485 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 55e9828e-9c08-47af-8346-935e976861ab response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
84502025-01-30T20:24:33.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 45e78a88-b2cc-47a2-9a02-bc2eae194a6c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84512025-01-30T20:24:33.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 45e78a88-b2cc-47a2-9a02-bc2eae194a6c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84522025-01-30T20:24:33.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 45e78a88-b2cc-47a2-9a02-bc2eae194a6c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84532025-01-30T20:24:34.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 21f63c19-5084-425d-a300-c09ea1c9bb5f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84542025-01-30T20:24:34.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 21f63c19-5084-425d-a300-c09ea1c9bb5f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84552025-01-30T20:24:34.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 21f63c19-5084-425d-a300-c09ea1c9bb5f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84562025-01-30T20:24:35.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 66fe3026-e32f-4cf6-bb1d-d15837d2dc5a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84572025-01-30T20:24:35.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 66fe3026-e32f-4cf6-bb1d-d15837d2dc5a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84582025-01-30T20:24:35.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 66fe3026-e32f-4cf6-bb1d-d15837d2dc5a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84592025-01-30T20:24:36.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f944d8d5-e51e-499e-b0f2-f154fa13e54e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84602025-01-30T20:24:36.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f944d8d5-e51e-499e-b0f2-f154fa13e54e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84612025-01-30T20:24:36.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f944d8d5-e51e-499e-b0f2-f154fa13e54e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84622025-01-30T20:24:37.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d1586382-c3cf-4963-9388-5c2891cce637 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84632025-01-30T20:24:37.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d1586382-c3cf-4963-9388-5c2891cce637 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84642025-01-30T20:24:37.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d1586382-c3cf-4963-9388-5c2891cce637 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84652025-01-30T20:24:38.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 94884321-49ce-4a67-9768-1d02cd44e396 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84662025-01-30T20:24:38.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 94884321-49ce-4a67-9768-1d02cd44e396 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84672025-01-30T20:24:38.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 94884321-49ce-4a67-9768-1d02cd44e396 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84682025-01-30T20:24:39.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 642e7485-6816-40bb-a288-85a7bb4e0586 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84692025-01-30T20:24:39.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 642e7485-6816-40bb-a288-85a7bb4e0586 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84702025-01-30T20:24:39.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 642e7485-6816-40bb-a288-85a7bb4e0586 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84712025-01-30T20:24:40.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e3049037-2735-4e01-8069-a247cb9d3d37 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84722025-01-30T20:24:40.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e3049037-2735-4e01-8069-a247cb9d3d37 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84732025-01-30T20:24:40.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e3049037-2735-4e01-8069-a247cb9d3d37 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84742025-01-30T20:24:40.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
84752025-01-30T20:24:40.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84762025-01-30T20:24:40.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
84772025-01-30T20:24:40.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84782025-01-30T20:24:40.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84792025-01-30T20:24:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84802025-01-30T20:24:40.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84812025-01-30T20:24:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84822025-01-30T20:24:40.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84832025-01-30T20:24:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84842025-01-30T20:24:40.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84852025-01-30T20:24:40.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84862025-01-30T20:24:40.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84872025-01-30T20:24:40.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
84882025-01-30T20:24:40.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84892025-01-30T20:24:40.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84902025-01-30T20:24:40.829ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
84912025-01-30T20:24:40.829ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.46684ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
84922025-01-30T20:24:40.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84932025-01-30T20:24:40.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84942025-01-30T20:24:40.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.575909ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84952025-01-30T20:24:41.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 04850c22-fcba-4908-9872-760ddd6f911c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84962025-01-30T20:24:41.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 04850c22-fcba-4908-9872-760ddd6f911c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84972025-01-30T20:24:41.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 04850c22-fcba-4908-9872-760ddd6f911c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
84982025-01-30T20:24:42.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 594 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 965afbe5-3282-4c57-bb1e-82f5090ff541 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
84992025-01-30T20:24:42.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b1600d8c-893f-439f-82cc-d508b28f48d7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85002025-01-30T20:24:42.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b1600d8c-893f-439f-82cc-d508b28f48d7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85012025-01-30T20:24:42.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b1600d8c-893f-439f-82cc-d508b28f48d7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85022025-01-30T20:24:43.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dca5c6cf-81f1-4ed4-a780-bc90e4bacdf1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85032025-01-30T20:24:43.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dca5c6cf-81f1-4ed4-a780-bc90e4bacdf1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85042025-01-30T20:24:43.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dca5c6cf-81f1-4ed4-a780-bc90e4bacdf1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85052025-01-30T20:24:44.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0a2f1c47-cab2-4927-9141-e59459ea661b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85062025-01-30T20:24:44.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0a2f1c47-cab2-4927-9141-e59459ea661b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85072025-01-30T20:24:44.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0a2f1c47-cab2-4927-9141-e59459ea661b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85082025-01-30T20:24:45.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 880fbc7c-69d5-475f-bbc4-610ef95d38b2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85092025-01-30T20:24:45.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 880fbc7c-69d5-475f-bbc4-610ef95d38b2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85102025-01-30T20:24:45.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 880fbc7c-69d5-475f-bbc4-610ef95d38b2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85112025-01-30T20:24:46.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c931795a-870b-4707-96c0-bf88aa0c63a9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85122025-01-30T20:24:46.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c931795a-870b-4707-96c0-bf88aa0c63a9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85132025-01-30T20:24:46.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c931795a-870b-4707-96c0-bf88aa0c63a9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85142025-01-30T20:24:47.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 423c6538-b335-4cd0-9436-0c3cfdaabfc3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85152025-01-30T20:24:47.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 423c6538-b335-4cd0-9436-0c3cfdaabfc3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85162025-01-30T20:24:47.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 423c6538-b335-4cd0-9436-0c3cfdaabfc3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85172025-01-30T20:24:48.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ce26e1ae-3652-4776-bf22-daef7bdf0fef roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85182025-01-30T20:24:48.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ce26e1ae-3652-4776-bf22-daef7bdf0fef resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85192025-01-30T20:24:48.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ce26e1ae-3652-4776-bf22-daef7bdf0fef response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85202025-01-30T20:24:49.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a9c70b38-dd3c-4219-b931-e9a1d274347a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85212025-01-30T20:24:49.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a9c70b38-dd3c-4219-b931-e9a1d274347a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85222025-01-30T20:24:49.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a9c70b38-dd3c-4219-b931-e9a1d274347a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85232025-01-30T20:24:50.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 46e4143d-7e87-4125-affb-93d315a56cf9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85242025-01-30T20:24:50.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 46e4143d-7e87-4125-affb-93d315a56cf9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85252025-01-30T20:24:50.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 46e4143d-7e87-4125-affb-93d315a56cf9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85262025-01-30T20:24:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
85272025-01-30T20:24:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
85282025-01-30T20:24:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85292025-01-30T20:24:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85302025-01-30T20:24:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85312025-01-30T20:24:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85322025-01-30T20:24:50.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85332025-01-30T20:24:50.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85342025-01-30T20:24:50.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85352025-01-30T20:24:50.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85362025-01-30T20:24:50.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85372025-01-30T20:24:50.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85382025-01-30T20:24:50.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85392025-01-30T20:24:50.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85402025-01-30T20:24:50.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.543411ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85412025-01-30T20:24:50.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85422025-01-30T20:24:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
85432025-01-30T20:24:50.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85442025-01-30T20:24:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85452025-01-30T20:24:50.857ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
85462025-01-30T20:24:50.857ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.535921ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
85472025-01-30T20:24:51.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd1526ea-32f0-402b-a453-b08e3205f443 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85482025-01-30T20:24:51.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd1526ea-32f0-402b-a453-b08e3205f443 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85492025-01-30T20:24:51.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd1526ea-32f0-402b-a453-b08e3205f443 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85502025-01-30T20:24:52.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 477 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 4c20ed11-18b2-4c63-86a1-a024fe15e309 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
85512025-01-30T20:24:52.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7383ea57-42eb-420c-a805-118472e553d9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85522025-01-30T20:24:52.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7383ea57-42eb-420c-a805-118472e553d9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85532025-01-30T20:24:52.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7383ea57-42eb-420c-a805-118472e553d9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85542025-01-30T20:24:53.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0d00b949-f404-4bb9-b16d-fe904599e122 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85552025-01-30T20:24:53.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0d00b949-f404-4bb9-b16d-fe904599e122 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85562025-01-30T20:24:53.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0d00b949-f404-4bb9-b16d-fe904599e122 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85572025-01-30T20:24:54.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 64224a57-2be3-47fe-9377-20f6bbfb232f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85582025-01-30T20:24:54.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 64224a57-2be3-47fe-9377-20f6bbfb232f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85592025-01-30T20:24:54.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 64224a57-2be3-47fe-9377-20f6bbfb232f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85602025-01-30T20:24:55.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1a4b2954-4f6b-4939-a7b6-85826a8b1045 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85612025-01-30T20:24:55.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1a4b2954-4f6b-4939-a7b6-85826a8b1045 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85622025-01-30T20:24:55.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1a4b2954-4f6b-4939-a7b6-85826a8b1045 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85632025-01-30T20:24:56.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 38a29eac-4702-4c4f-97ae-ab7e138151d5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85642025-01-30T20:24:56.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 38a29eac-4702-4c4f-97ae-ab7e138151d5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85652025-01-30T20:24:56.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 38a29eac-4702-4c4f-97ae-ab7e138151d5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85662025-01-30T20:24:57.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df3ec8fd-ef46-4bcd-a635-911694156cb5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85672025-01-30T20:24:57.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df3ec8fd-ef46-4bcd-a635-911694156cb5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85682025-01-30T20:24:57.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df3ec8fd-ef46-4bcd-a635-911694156cb5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85692025-01-30T20:24:58.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9e4ddd27-0b09-4bec-93c3-14d16c758af5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85702025-01-30T20:24:58.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9e4ddd27-0b09-4bec-93c3-14d16c758af5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85712025-01-30T20:24:58.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9e4ddd27-0b09-4bec-93c3-14d16c758af5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85722025-01-30T20:24:59.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a163b460-97f3-4365-9e73-af11d6c4dcd5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85732025-01-30T20:24:59.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a163b460-97f3-4365-9e73-af11d6c4dcd5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85742025-01-30T20:24:59.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a163b460-97f3-4365-9e73-af11d6c4dcd5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
85752025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
85762025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85772025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
85782025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85792025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
85802025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
85812025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85822025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85832025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
85842025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
85852025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
85862025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
85872025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
85882025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85892025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
85902025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
85912025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
85922025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85932025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
85942025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85952025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
85962025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85972025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85982025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
85992025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
86002025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
86012025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86022025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
86032025-01-30T20:25:00.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
86042025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86052025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
86062025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86072025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
86082025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
86092025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86102025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
86112025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86122025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86132025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86142025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86152025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
86162025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
86172025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86182025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86192025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86202025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86212025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86222025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86232025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86242025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
86252025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
86262025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86272025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86282025-01-30T20:25:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86292025-01-30T20:25:00.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86302025-01-30T20:25:00.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86312025-01-30T20:25:00.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.997501ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
86322025-01-30T20:25:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86332025-01-30T20:25:00.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86342025-01-30T20:25:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
86352025-01-30T20:25:00.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86362025-01-30T20:25:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86372025-01-30T20:25:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86382025-01-30T20:25:00.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86392025-01-30T20:25:00.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2652, tv_nsec: 18820930 } })
86402025-01-30T20:25:00.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
86412025-01-30T20:25:00.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86422025-01-30T20:25:00.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86432025-01-30T20:25:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86442025-01-30T20:25:00.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86452025-01-30T20:25:00.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2652, tv_nsec: 22747629 } })
86462025-01-30T20:25:00.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
86472025-01-30T20:25:00.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86482025-01-30T20:25:00.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86492025-01-30T20:25:00.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2652, tv_nsec: 24866837 } })
86502025-01-30T20:25:00.815ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
86512025-01-30T20:25:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
86522025-01-30T20:25:00.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86532025-01-30T20:25:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86542025-01-30T20:25:00.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86552025-01-30T20:25:00.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86562025-01-30T20:25:00.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.545229ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
86572025-01-30T20:25:00.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.320754ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
86582025-01-30T20:25:00.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86592025-01-30T20:25:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
86602025-01-30T20:25:00.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86612025-01-30T20:25:00.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86622025-01-30T20:25:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86632025-01-30T20:25:00.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86642025-01-30T20:25:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86652025-01-30T20:25:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86662025-01-30T20:25:00.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86672025-01-30T20:25:00.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.970579ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86682025-01-30T20:25:00.860ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86692025-01-30T20:25:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86702025-01-30T20:25:00.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86712025-01-30T20:25:00.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86722025-01-30T20:25:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86732025-01-30T20:25:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86742025-01-30T20:25:00.862ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86752025-01-30T20:25:00.862ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
86762025-01-30T20:25:00.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86772025-01-30T20:25:00.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86782025-01-30T20:25:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86792025-01-30T20:25:00.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 61.587829ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86802025-01-30T20:25:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
86812025-01-30T20:25:00.862ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
86822025-01-30T20:25:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
86832025-01-30T20:25:00.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86842025-01-30T20:25:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86852025-01-30T20:25:00.864ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86862025-01-30T20:25:00.864ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.880185ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86872025-01-30T20:25:00.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86882025-01-30T20:25:00.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86892025-01-30T20:25:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86902025-01-30T20:25:00.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86912025-01-30T20:25:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86922025-01-30T20:25:00.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86932025-01-30T20:25:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86942025-01-30T20:25:00.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86952025-01-30T20:25:00.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86962025-01-30T20:25:00.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86972025-01-30T20:25:00.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86982025-01-30T20:25:00.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86992025-01-30T20:25:00.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87002025-01-30T20:25:00.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87012025-01-30T20:25:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
87022025-01-30T20:25:00.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87032025-01-30T20:25:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87042025-01-30T20:25:00.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87052025-01-30T20:25:00.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
87062025-01-30T20:25:00.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87072025-01-30T20:25:00.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87082025-01-30T20:25:00.874ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 73.298115ms iteration = 16 status = 0
87092025-01-30T20:25:00.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f75e19c8-2eac-4d39-a16d-83d9116e3caf roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
87102025-01-30T20:25:00.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f75e19c8-2eac-4d39-a16d-83d9116e3caf resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
87112025-01-30T20:25:00.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f75e19c8-2eac-4d39-a16d-83d9116e3caf response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
87122025-01-30T20:25:00.881ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
87132025-01-30T20:25:00.881ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.844294ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
87142025-01-30T20:25:00.886ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87152025-01-30T20:25:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87162025-01-30T20:25:00.892ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87172025-01-30T20:25:00.892ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
87182025-01-30T20:25:00.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87192025-01-30T20:25:00.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87202025-01-30T20:25:00.893ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
87212025-01-30T20:25:00.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
87222025-01-30T20:25:00.894ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
87232025-01-30T20:25:00.894ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87242025-01-30T20:25:00.894ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9aa7dc9d-b4b8-4e35-bb31-76ad6a027925", "content-length": "26", "date": "Thu, 30 Jan 2025 20:25:00 GMT"} })
87252025-01-30T20:25:00.895ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87262025-01-30T20:25:00.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.803693ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87272025-01-30T20:25:00.896ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87282025-01-30T20:25:00.910ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
87292025-01-30T20:25:00.910ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87302025-01-30T20:25:00.911ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f07ca459-b942-492f-bac4-8649293bdfac", "content-length": "26", "date": "Thu, 30 Jan 2025 20:25:00 GMT"} })
87312025-01-30T20:25:00.911ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87322025-01-30T20:25:00.912ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87332025-01-30T20:25:00.918ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
87342025-01-30T20:25:00.918ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87352025-01-30T20:25:00.918ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c9ecd34-ca02-473d-b30f-03b6b4a711a8", "content-length": "26", "date": "Thu, 30 Jan 2025 20:25:00 GMT"} })
87362025-01-30T20:25:00.918ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87372025-01-30T20:25:00.920ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
87382025-01-30T20:25:00.920ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87392025-01-30T20:25:00.920ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
87402025-01-30T20:25:00.920ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.678142ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
87412025-01-30T20:25:00.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.942044ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
87422025-01-30T20:25:00.927ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87432025-01-30T20:25:00.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87442025-01-30T20:25:00.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87452025-01-30T20:25:00.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
87462025-01-30T20:25:00.929ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
87472025-01-30T20:25:00.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
87482025-01-30T20:25:00.963ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
87492025-01-30T20:25:00.963ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 161.77215ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
87502025-01-30T20:25:00.969ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.730455ms iteration = 18 status = {"physical_disks_added":0}
87512025-01-30T20:25:00.993ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
87522025-01-30T20:25:00.993ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a9f205c-fca2-4f18-b000-7bad7c76c25a", "content-length": "1", "date": "Thu, 30 Jan 2025 20:25:00 GMT"} })
87532025-01-30T20:25:00.994ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87542025-01-30T20:25:00.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87552025-01-30T20:25:01.000ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 199.716753ms iteration = 16 status = null
87562025-01-30T20:25:01.006ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 205.7271ms iteration = 16 status = {}
87572025-01-30T20:25:01.027ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
87582025-01-30T20:25:01.027ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87592025-01-30T20:25:01.027ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e614e0c-0161-44cb-aa4f-5611f58e6d8d", "content-length": "372", "date": "Thu, 30 Jan 2025 20:25:01 GMT"} })
87602025-01-30T20:25:01.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87612025-01-30T20:25:01.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87622025-01-30T20:25:01.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87632025-01-30T20:25:01.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87642025-01-30T20:25:01.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87652025-01-30T20:25:01.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87662025-01-30T20:25:01.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87672025-01-30T20:25:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87682025-01-30T20:25:01.063ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87692025-01-30T20:25:01.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87702025-01-30T20:25:01.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87712025-01-30T20:25:01.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87722025-01-30T20:25:01.068ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
87732025-01-30T20:25:01.068ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87742025-01-30T20:25:01.068ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ab0c17a5-f1f0-4e57-bde9-75dac8feef4a", "date": "Thu, 30 Jan 2025 20:25:01 GMT"} })
87752025-01-30T20:25:01.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87762025-01-30T20:25:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87772025-01-30T20:25:01.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87782025-01-30T20:25:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87792025-01-30T20:25:01.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87802025-01-30T20:25:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87812025-01-30T20:25:01.077ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87822025-01-30T20:25:01.077ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87832025-01-30T20:25:01.077ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "15f69813-2e91-45c5-9eab-61b2670b1336", "date": "Thu, 30 Jan 2025 20:25:01 GMT"} })
87842025-01-30T20:25:01.078ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 277.670077ms iteration = 16 status = {}
87852025-01-30T20:25:01.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87862025-01-30T20:25:01.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87872025-01-30T20:25:01.114ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87882025-01-30T20:25:01.114ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b3a8a34-835a-424a-8b6f-853b783e0524", "content-length": "691", "date": "Thu, 30 Jan 2025 20:25:01 GMT"} })
87892025-01-30T20:25:01.114ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
87902025-01-30T20:25:01.115ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
87912025-01-30T20:25:01.115ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
87922025-01-30T20:25:01.115ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 314.391796ms iteration = 16 status = {}
87932025-01-30T20:25:01.119ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
87942025-01-30T20:25:01.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87952025-01-30T20:25:01.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87962025-01-30T20:25:01.140ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87972025-01-30T20:25:01.141ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "92280ca6-6417-4c70-b43c-bf9120253d90", "content-length": "134", "date": "Thu, 30 Jan 2025 20:25:00 GMT"} })
87982025-01-30T20:25:01.141ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
87992025-01-30T20:25:01.141ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
88002025-01-30T20:25:01.141ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
88012025-01-30T20:25:01.141ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
88022025-01-30T20:25:01.141ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88032025-01-30T20:25:01.141ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88042025-01-30T20:25:01.141ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88052025-01-30T20:25:01.141ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88062025-01-30T20:25:01.141ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88072025-01-30T20:25:01.141ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88082025-01-30T20:25:01.142ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
88092025-01-30T20:25:01.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88102025-01-30T20:25:01.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88112025-01-30T20:25:01.145ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
88122025-01-30T20:25:01.145ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e0f03ca-7c26-44b3-b2c0-727c449a7f5f", "content-length": "2", "date": "Thu, 30 Jan 2025 20:25:00 GMT"} })
88132025-01-30T20:25:01.145ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
88142025-01-30T20:25:01.145ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c4f74e2-c68b-41fb-ad15-58eb6a905e3b", "content-length": "52", "date": "Thu, 30 Jan 2025 20:25:00 GMT"} })
88152025-01-30T20:25:01.145ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
88162025-01-30T20:25:01.145ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
88172025-01-30T20:25:01.296ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c94b772a-c6d5-4e47-9408-6ebf9cedc43f", "date": "Thu, 30 Jan 2025 20:25:01 GMT"} })
88182025-01-30T20:25:01.296ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
88192025-01-30T20:25:01.296ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
88202025-01-30T20:25:01.297ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ce69889-8560-4e7c-982b-570945a354ae", "content-length": "682", "date": "Thu, 30 Jan 2025 20:25:01 GMT"} })
88212025-01-30T20:25:01.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88222025-01-30T20:25:01.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88232025-01-30T20:25:01.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88242025-01-30T20:25:01.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88252025-01-30T20:25:01.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88262025-01-30T20:25:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88272025-01-30T20:25:01.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88282025-01-30T20:25:01.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88292025-01-30T20:25:01.319ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 517.923444ms iteration = 16 status = {}
88302025-01-30T20:25:01.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a74c76d8-c370-4d14-abcd-f10daac126df roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
88312025-01-30T20:25:01.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a74c76d8-c370-4d14-abcd-f10daac126df resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
88322025-01-30T20:25:01.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a74c76d8-c370-4d14-abcd-f10daac126df response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
88332025-01-30T20:25:01.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 04a493dd-e243-49e5-99ca-2ba599bc517d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88342025-01-30T20:25:01.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 04a493dd-e243-49e5-99ca-2ba599bc517d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88352025-01-30T20:25:01.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 04a493dd-e243-49e5-99ca-2ba599bc517d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88362025-01-30T20:25:02.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 478 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 963551f3-47c2-4c0d-b77c-afd6edcec543 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
88372025-01-30T20:25:02.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f05442a8-3b39-425d-812c-4a266206c645 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88382025-01-30T20:25:02.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f05442a8-3b39-425d-812c-4a266206c645 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88392025-01-30T20:25:02.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f05442a8-3b39-425d-812c-4a266206c645 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88402025-01-30T20:25:03.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ad4e0e3b-a66a-4c3f-8909-1c983f129200 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88412025-01-30T20:25:03.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ad4e0e3b-a66a-4c3f-8909-1c983f129200 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88422025-01-30T20:25:03.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ad4e0e3b-a66a-4c3f-8909-1c983f129200 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88432025-01-30T20:25:04.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 81381561-31ac-42e3-8a9a-c19d7df8dd16 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88442025-01-30T20:25:04.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 81381561-31ac-42e3-8a9a-c19d7df8dd16 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88452025-01-30T20:25:04.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 81381561-31ac-42e3-8a9a-c19d7df8dd16 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88462025-01-30T20:25:05.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dfd6c87c-a4a2-4211-95f1-a4f3046771ed roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88472025-01-30T20:25:05.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dfd6c87c-a4a2-4211-95f1-a4f3046771ed resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88482025-01-30T20:25:05.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dfd6c87c-a4a2-4211-95f1-a4f3046771ed response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88492025-01-30T20:25:07.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 883bf3a0-37c1-4191-857f-a7a94df853ef roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88502025-01-30T20:25:07.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 883bf3a0-37c1-4191-857f-a7a94df853ef resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88512025-01-30T20:25:07.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 883bf3a0-37c1-4191-857f-a7a94df853ef response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88522025-01-30T20:25:08.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0b2ed109-8e8e-44d4-b4ea-09127b38f749 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88532025-01-30T20:25:08.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0b2ed109-8e8e-44d4-b4ea-09127b38f749 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88542025-01-30T20:25:08.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0b2ed109-8e8e-44d4-b4ea-09127b38f749 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88552025-01-30T20:25:09.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 131cf79c-5ee1-4f1c-b369-4a8c58e1c05a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88562025-01-30T20:25:09.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 131cf79c-5ee1-4f1c-b369-4a8c58e1c05a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88572025-01-30T20:25:09.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 131cf79c-5ee1-4f1c-b369-4a8c58e1c05a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88582025-01-30T20:25:10.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3909a5d3-f277-4ed3-8011-a2cf58cb6d34 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88592025-01-30T20:25:10.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3909a5d3-f277-4ed3-8011-a2cf58cb6d34 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88602025-01-30T20:25:10.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3909a5d3-f277-4ed3-8011-a2cf58cb6d34 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88612025-01-30T20:25:10.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
88622025-01-30T20:25:10.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88632025-01-30T20:25:10.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
88642025-01-30T20:25:10.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88652025-01-30T20:25:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88662025-01-30T20:25:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88672025-01-30T20:25:10.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88682025-01-30T20:25:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88692025-01-30T20:25:10.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88702025-01-30T20:25:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88712025-01-30T20:25:10.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88722025-01-30T20:25:10.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88732025-01-30T20:25:10.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88742025-01-30T20:25:10.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
88752025-01-30T20:25:10.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88762025-01-30T20:25:10.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88772025-01-30T20:25:10.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
88782025-01-30T20:25:10.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.842768ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
88792025-01-30T20:25:10.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88802025-01-30T20:25:10.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88812025-01-30T20:25:10.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.014986ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88822025-01-30T20:25:11.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ba5e27a-2090-44a1-9b6e-c6724c9f7302 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88832025-01-30T20:25:11.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ba5e27a-2090-44a1-9b6e-c6724c9f7302 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88842025-01-30T20:25:11.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3ba5e27a-2090-44a1-9b6e-c6724c9f7302 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88852025-01-30T20:25:12.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 51c8cec6-a157-4c59-bbf6-c7b9f2abbc8b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88862025-01-30T20:25:12.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 51c8cec6-a157-4c59-bbf6-c7b9f2abbc8b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88872025-01-30T20:25:12.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 51c8cec6-a157-4c59-bbf6-c7b9f2abbc8b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88882025-01-30T20:25:12.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 549 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 842cb3da-5d21-410f-96ca-3574e3815409 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
88892025-01-30T20:25:13.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ccdebd4c-ff4b-4947-8166-c033db3338e7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88902025-01-30T20:25:13.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ccdebd4c-ff4b-4947-8166-c033db3338e7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88912025-01-30T20:25:13.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ccdebd4c-ff4b-4947-8166-c033db3338e7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88922025-01-30T20:25:14.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ef45b406-a4e1-4435-916c-cd6f002f92de roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88932025-01-30T20:25:14.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ef45b406-a4e1-4435-916c-cd6f002f92de resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88942025-01-30T20:25:14.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ef45b406-a4e1-4435-916c-cd6f002f92de response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88952025-01-30T20:25:15.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e155582f-34f4-4cb8-90c1-e11051feba88 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88962025-01-30T20:25:15.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e155582f-34f4-4cb8-90c1-e11051feba88 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88972025-01-30T20:25:15.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e155582f-34f4-4cb8-90c1-e11051feba88 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88982025-01-30T20:25:16.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ce3b0be5-edc1-4513-8a59-e20bf7708769 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
88992025-01-30T20:25:16.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ce3b0be5-edc1-4513-8a59-e20bf7708769 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89002025-01-30T20:25:16.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ce3b0be5-edc1-4513-8a59-e20bf7708769 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89012025-01-30T20:25:17.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bdfa97f7-5b2a-4bcd-b558-65acc6095fd7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89022025-01-30T20:25:17.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bdfa97f7-5b2a-4bcd-b558-65acc6095fd7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89032025-01-30T20:25:17.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bdfa97f7-5b2a-4bcd-b558-65acc6095fd7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89042025-01-30T20:25:17.440ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:50185
89052025-01-30T20:25:17.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = ff56cbc8-a3f7-4ecf-9284-1d5d3980c5b8 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
89062025-01-30T20:25:17.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = ff56cbc8-a3f7-4ecf-9284-1d5d3980c5b8 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
89072025-01-30T20:25:17.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = ff56cbc8-a3f7-4ecf-9284-1d5d3980c5b8 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
89082025-01-30T20:25:17.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 58d94305-caa5-49d1-a4b6-0190ec57d33b roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
89092025-01-30T20:25:17.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 58d94305-caa5-49d1-a4b6-0190ec57d33b resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
89102025-01-30T20:25:17.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 58d94305-caa5-49d1-a4b6-0190ec57d33b response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
89112025-01-30T20:25:18.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a28cc297-c112-440b-aced-b5dccea54f20 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89122025-01-30T20:25:18.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a28cc297-c112-440b-aced-b5dccea54f20 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89132025-01-30T20:25:18.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a28cc297-c112-440b-aced-b5dccea54f20 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89142025-01-30T20:25:19.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4a0c03dd-167d-412d-bb23-c76684f37027 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89152025-01-30T20:25:19.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4a0c03dd-167d-412d-bb23-c76684f37027 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89162025-01-30T20:25:19.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4a0c03dd-167d-412d-bb23-c76684f37027 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89172025-01-30T20:25:20.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ec998397-95f0-4537-a0ad-face57c97dcf roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89182025-01-30T20:25:20.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ec998397-95f0-4537-a0ad-face57c97dcf resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89192025-01-30T20:25:20.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ec998397-95f0-4537-a0ad-face57c97dcf response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89202025-01-30T20:25:20.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
89212025-01-30T20:25:20.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89222025-01-30T20:25:20.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
89232025-01-30T20:25:20.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89242025-01-30T20:25:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89252025-01-30T20:25:20.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89262025-01-30T20:25:20.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89272025-01-30T20:25:20.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89282025-01-30T20:25:20.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89292025-01-30T20:25:20.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.269588ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89302025-01-30T20:25:20.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89312025-01-30T20:25:20.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89322025-01-30T20:25:20.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89332025-01-30T20:25:20.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89342025-01-30T20:25:20.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89352025-01-30T20:25:20.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89362025-01-30T20:25:20.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
89372025-01-30T20:25:20.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89382025-01-30T20:25:20.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89392025-01-30T20:25:20.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
89402025-01-30T20:25:20.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.320052ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
89412025-01-30T20:25:21.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0bb3555c-4f11-40b6-81ef-2bfd63883cd3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89422025-01-30T20:25:21.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0bb3555c-4f11-40b6-81ef-2bfd63883cd3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89432025-01-30T20:25:21.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0bb3555c-4f11-40b6-81ef-2bfd63883cd3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89442025-01-30T20:25:22.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2ba6bd5d-2f85-4294-b21d-a26a2ee89c5f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89452025-01-30T20:25:22.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2ba6bd5d-2f85-4294-b21d-a26a2ee89c5f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89462025-01-30T20:25:22.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2ba6bd5d-2f85-4294-b21d-a26a2ee89c5f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89472025-01-30T20:25:22.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 465 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = f3d0be94-0c8c-4b72-8df4-69f4270552e3 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
89482025-01-30T20:25:23.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 231041fa-e31e-47dc-bd50-b13cd7100259 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89492025-01-30T20:25:23.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 231041fa-e31e-47dc-bd50-b13cd7100259 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89502025-01-30T20:25:23.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 231041fa-e31e-47dc-bd50-b13cd7100259 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89512025-01-30T20:25:24.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f6f84692-147b-4afc-b792-87d05efa83af roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89522025-01-30T20:25:24.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f6f84692-147b-4afc-b792-87d05efa83af resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89532025-01-30T20:25:24.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f6f84692-147b-4afc-b792-87d05efa83af response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89542025-01-30T20:25:25.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bfebecd8-655f-4f21-a4be-882d87146368 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89552025-01-30T20:25:25.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bfebecd8-655f-4f21-a4be-882d87146368 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89562025-01-30T20:25:25.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bfebecd8-655f-4f21-a4be-882d87146368 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89572025-01-30T20:25:26.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bd4747b1-df50-416c-b221-c0b2b4339b8a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89582025-01-30T20:25:26.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bd4747b1-df50-416c-b221-c0b2b4339b8a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89592025-01-30T20:25:26.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bd4747b1-df50-416c-b221-c0b2b4339b8a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89602025-01-30T20:25:27.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e306f438-a90f-4938-9e70-0db1753ffa07 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89612025-01-30T20:25:27.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e306f438-a90f-4938-9e70-0db1753ffa07 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89622025-01-30T20:25:27.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e306f438-a90f-4938-9e70-0db1753ffa07 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89632025-01-30T20:25:28.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = afde3749-a2a9-46ac-a919-7d428b2159ee roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89642025-01-30T20:25:28.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = afde3749-a2a9-46ac-a919-7d428b2159ee resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89652025-01-30T20:25:28.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = afde3749-a2a9-46ac-a919-7d428b2159ee response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89662025-01-30T20:25:29.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6dfe1149-90cc-45c2-9b1a-3b1d7ac07fe6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89672025-01-30T20:25:29.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6dfe1149-90cc-45c2-9b1a-3b1d7ac07fe6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89682025-01-30T20:25:29.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6dfe1149-90cc-45c2-9b1a-3b1d7ac07fe6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89692025-01-30T20:25:30.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f589068-f369-46be-864f-ac1fdcfd5265 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89702025-01-30T20:25:30.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f589068-f369-46be-864f-ac1fdcfd5265 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89712025-01-30T20:25:30.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f589068-f369-46be-864f-ac1fdcfd5265 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
89722025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
89732025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
89742025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89752025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
89762025-01-30T20:25:30.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89772025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89782025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
89792025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89802025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
89812025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89822025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
89832025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
89842025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89852025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
89862025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
89872025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
89882025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89892025-01-30T20:25:30.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:15:30.801379047 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
89902025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
89912025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
89922025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
89932025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
89942025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
89952025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
89962025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
89972025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89982025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
89992025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90002025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
90012025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
90022025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
90032025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90042025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
90052025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
90062025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
90072025-01-30T20:25:30.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
90082025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.351\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
90092025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
90102025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
90112025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90122025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
90132025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
90142025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
90152025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
90162025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90172025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
90182025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
90192025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
90202025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
90212025-01-30T20:25:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
90222025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90232025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
90242025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
90252025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90262025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
90272025-01-30T20:25:30.802ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
90282025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90292025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
90302025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
90312025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90322025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90332025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
90342025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90352025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
90362025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90372025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90382025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90392025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90402025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
90412025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90422025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90432025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90442025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
90452025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
90462025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90472025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90482025-01-30T20:25:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2682, tv_nsec: 12163565 } })
90492025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90502025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
90512025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90522025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90532025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90542025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90552025-01-30T20:25:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2682, tv_nsec: 12286728 } })
90562025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90572025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
90582025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90592025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
90602025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90612025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90622025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
90632025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
90642025-01-30T20:25:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.44591ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
90652025-01-30T20:25:30.803ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
90662025-01-30T20:25:30.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.373338ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
90672025-01-30T20:25:30.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90682025-01-30T20:25:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.711223ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
90692025-01-30T20:25:30.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90702025-01-30T20:25:30.806ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:15:30.801379047 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
90712025-01-30T20:25:30.806ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.558165ms iteration = 9 status = {"expiration":"2025-01-30T20:15:30.801379047Z","pruned":[]}
90722025-01-30T20:25:30.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90732025-01-30T20:25:30.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90742025-01-30T20:25:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90752025-01-30T20:25:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
90762025-01-30T20:25:30.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90772025-01-30T20:25:30.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90782025-01-30T20:25:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90792025-01-30T20:25:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90802025-01-30T20:25:30.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.227126ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
90812025-01-30T20:25:30.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90822025-01-30T20:25:30.811ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90832025-01-30T20:25:30.811ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
90842025-01-30T20:25:30.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90852025-01-30T20:25:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90862025-01-30T20:25:30.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90872025-01-30T20:25:30.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2682, tv_nsec: 23373126 } })
90882025-01-30T20:25:30.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
90892025-01-30T20:25:30.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
90902025-01-30T20:25:30.814ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90912025-01-30T20:25:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90922025-01-30T20:25:30.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90932025-01-30T20:25:30.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90942025-01-30T20:25:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90952025-01-30T20:25:30.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90962025-01-30T20:25:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90972025-01-30T20:25:30.821ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90982025-01-30T20:25:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
90992025-01-30T20:25:30.825ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
91002025-01-30T20:25:30.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91012025-01-30T20:25:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
91022025-01-30T20:25:30.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91032025-01-30T20:25:30.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2682, tv_nsec: 36061758 } })
91042025-01-30T20:25:30.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
91052025-01-30T20:25:30.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91062025-01-30T20:25:30.828ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.439934ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
91072025-01-30T20:25:30.830ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91082025-01-30T20:25:30.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91092025-01-30T20:25:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91102025-01-30T20:25:30.830ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2682, tv_nsec: 40358107 } })
91112025-01-30T20:25:30.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
91122025-01-30T20:25:30.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91132025-01-30T20:25:30.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91142025-01-30T20:25:30.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91152025-01-30T20:25:30.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91162025-01-30T20:25:30.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91172025-01-30T20:25:30.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91182025-01-30T20:25:30.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91192025-01-30T20:25:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
91202025-01-30T20:25:30.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91212025-01-30T20:25:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91222025-01-30T20:25:30.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
91232025-01-30T20:25:30.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
91242025-01-30T20:25:30.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91252025-01-30T20:25:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91262025-01-30T20:25:30.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91272025-01-30T20:25:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91282025-01-30T20:25:30.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91292025-01-30T20:25:30.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91302025-01-30T20:25:30.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 57.244979ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
91312025-01-30T20:25:30.859ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
91322025-01-30T20:25:30.859ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
91332025-01-30T20:25:30.859ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.742802ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
91342025-01-30T20:25:30.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
91352025-01-30T20:25:30.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.318874ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
91362025-01-30T20:25:30.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.06755ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
91372025-01-30T20:25:30.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91382025-01-30T20:25:30.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91392025-01-30T20:25:30.868ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91402025-01-30T20:25:30.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91412025-01-30T20:25:30.870ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91422025-01-30T20:25:30.870ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
91432025-01-30T20:25:30.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91442025-01-30T20:25:30.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91452025-01-30T20:25:30.870ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91462025-01-30T20:25:30.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.105338ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91472025-01-30T20:25:30.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91482025-01-30T20:25:30.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91492025-01-30T20:25:30.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91502025-01-30T20:25:30.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91512025-01-30T20:25:30.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91522025-01-30T20:25:30.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.350433ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
91532025-01-30T20:25:30.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91542025-01-30T20:25:30.873ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91552025-01-30T20:25:30.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91562025-01-30T20:25:30.874ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91572025-01-30T20:25:30.874ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
91582025-01-30T20:25:30.874ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 72.929164ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
91592025-01-30T20:25:30.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91602025-01-30T20:25:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91612025-01-30T20:25:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91622025-01-30T20:25:30.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
91632025-01-30T20:25:30.876ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
91642025-01-30T20:25:30.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
91652025-01-30T20:25:30.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91662025-01-30T20:25:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
91672025-01-30T20:25:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91682025-01-30T20:25:30.878ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
91692025-01-30T20:25:30.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91702025-01-30T20:25:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
91712025-01-30T20:25:30.879ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
91722025-01-30T20:25:30.879ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
91732025-01-30T20:25:30.879ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
91742025-01-30T20:25:30.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91752025-01-30T20:25:30.879ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91762025-01-30T20:25:30.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91772025-01-30T20:25:30.880ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91782025-01-30T20:25:30.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91792025-01-30T20:25:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
91802025-01-30T20:25:30.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91812025-01-30T20:25:30.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91822025-01-30T20:25:30.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
91832025-01-30T20:25:30.882ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
91842025-01-30T20:25:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
91852025-01-30T20:25:30.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91862025-01-30T20:25:30.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91872025-01-30T20:25:30.884ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
91882025-01-30T20:25:30.884ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.947432ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
91892025-01-30T20:25:30.884ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
91902025-01-30T20:25:30.884ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 83.549999ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
91912025-01-30T20:25:30.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91922025-01-30T20:25:30.885ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
91932025-01-30T20:25:30.885ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
91942025-01-30T20:25:30.885ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
91952025-01-30T20:25:30.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91962025-01-30T20:25:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91972025-01-30T20:25:30.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91982025-01-30T20:25:30.888ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91992025-01-30T20:25:30.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92002025-01-30T20:25:30.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92012025-01-30T20:25:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92022025-01-30T20:25:30.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92032025-01-30T20:25:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92042025-01-30T20:25:30.897ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
92052025-01-30T20:25:30.897ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
92062025-01-30T20:25:30.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92072025-01-30T20:25:30.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
92082025-01-30T20:25:30.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92092025-01-30T20:25:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
92102025-01-30T20:25:30.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92112025-01-30T20:25:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92122025-01-30T20:25:30.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92132025-01-30T20:25:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92142025-01-30T20:25:30.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.962921ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92152025-01-30T20:25:30.909ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
92162025-01-30T20:25:30.909ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
92172025-01-30T20:25:30.909ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-30 20:18:12.536035 UTC dns_group = internal generation = 1
92182025-01-30T20:25:30.909ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 107.636707ms iteration = 9 status = {"generation":1}
92192025-01-30T20:25:30.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92202025-01-30T20:25:30.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92212025-01-30T20:25:30.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92222025-01-30T20:25:30.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92232025-01-30T20:25:30.916ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
92242025-01-30T20:25:30.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92252025-01-30T20:25:30.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92262025-01-30T20:25:30.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92272025-01-30T20:25:30.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92282025-01-30T20:25:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92292025-01-30T20:25:30.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92302025-01-30T20:25:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92312025-01-30T20:25:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92322025-01-30T20:25:30.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92332025-01-30T20:25:30.925ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
92342025-01-30T20:25:30.925ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
92352025-01-30T20:25:30.925ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 123.462796ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
92362025-01-30T20:25:30.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
92372025-01-30T20:25:30.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92382025-01-30T20:25:30.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92392025-01-30T20:25:30.928ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 126.722167ms iteration = 17 status = 0
92402025-01-30T20:25:30.929ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) }
92412025-01-30T20:25:30.929ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 127.810957ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
92422025-01-30T20:25:30.954ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
92432025-01-30T20:25:30.954ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
92442025-01-30T20:25:30.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92452025-01-30T20:25:30.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92462025-01-30T20:25:30.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92472025-01-30T20:25:30.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92482025-01-30T20:25:30.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92492025-01-30T20:25:30.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92502025-01-30T20:25:30.961ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.411952ms iteration = 19 status = {"physical_disks_added":0}
92512025-01-30T20:25:30.962ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
92522025-01-30T20:25:30.962ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
92532025-01-30T20:25:30.962ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-30 20:18:13.133071 UTC dns_group = external generation = 2
92542025-01-30T20:25:30.962ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 160.731061ms iteration = 9 status = {"generation":2}
92552025-01-30T20:25:30.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92562025-01-30T20:25:30.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92572025-01-30T20:25:30.964ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92582025-01-30T20:25:30.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92592025-01-30T20:25:30.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92602025-01-30T20:25:30.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92612025-01-30T20:25:30.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92622025-01-30T20:25:30.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92632025-01-30T20:25:30.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92642025-01-30T20:25:30.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92652025-01-30T20:25:31.000ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
92662025-01-30T20:25:31.000ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92672025-01-30T20:25:31.000ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2516053-db07-4ee4-a09c-31694741c3d9", "content-length": "26", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} })
92682025-01-30T20:25:31.000ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92692025-01-30T20:25:31.003ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92702025-01-30T20:25:31.003ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
92712025-01-30T20:25:31.011ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
92722025-01-30T20:25:31.011ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 210.054099ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
92732025-01-30T20:25:31.021ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
92742025-01-30T20:25:31.021ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92752025-01-30T20:25:31.021ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "075d2902-2eeb-405f-8395-531d898eb5ca", "content-length": "26", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} })
92762025-01-30T20:25:31.021ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92772025-01-30T20:25:31.024ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92782025-01-30T20:25:31.102ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
92792025-01-30T20:25:31.102ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4eb1c677-10e3-4247-9a0f-eb53db41abbd", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92802025-01-30T20:25:31.102ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92812025-01-30T20:25:31.105ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b1cb6c85-b90c-4d0a-a28c-8d5e3e4582e5", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92822025-01-30T20:25:31.105ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92832025-01-30T20:25:31.107ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92842025-01-30T20:25:31.107ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 305.698714ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
92852025-01-30T20:25:31.127ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
92862025-01-30T20:25:31.127ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92872025-01-30T20:25:31.128ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de630b63-7826-4d8d-a0eb-be0b2ff74a76", "content-length": "26", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} })
92882025-01-30T20:25:31.128ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92892025-01-30T20:25:31.130ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
92902025-01-30T20:25:31.180ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
92912025-01-30T20:25:31.181ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f149e133-c5aa-423e-9f40-081214f3b095", "content-length": "691", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} })
92922025-01-30T20:25:31.181ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
92932025-01-30T20:25:31.181ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
92942025-01-30T20:25:31.181ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
92952025-01-30T20:25:31.183ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 382.080905ms iteration = 17 status = {}
92962025-01-30T20:25:31.202ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
92972025-01-30T20:25:31.203ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
92982025-01-30T20:25:31.203ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92992025-01-30T20:25:31.203ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "767eb460-7a95-491c-8905-f9350b4449fa", "content-length": "1", "date": "Thu, 30 Jan 2025 20:25:30 GMT"} })
93002025-01-30T20:25:31.203ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7faae2c1-aa41-48ee-b411-3dd3e278cd52", "content-length": "372", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} })
93012025-01-30T20:25:31.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93022025-01-30T20:25:31.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93032025-01-30T20:25:31.205ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93042025-01-30T20:25:31.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93052025-01-30T20:25:31.208ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 406.873912ms iteration = 17 status = null
93062025-01-30T20:25:31.233ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
93072025-01-30T20:25:31.259ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 457.772686ms iteration = 17 status = {}
93082025-01-30T20:25:31.291ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
93092025-01-30T20:25:31.291ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93102025-01-30T20:25:31.291ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4eccaf4f-e633-4030-95ac-789e8d5f4e88", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} })
93112025-01-30T20:25:31.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93122025-01-30T20:25:31.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93132025-01-30T20:25:31.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93142025-01-30T20:25:31.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93152025-01-30T20:25:31.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93162025-01-30T20:25:31.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93172025-01-30T20:25:31.314ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93182025-01-30T20:25:31.314ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93192025-01-30T20:25:31.315ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "764d4166-0b76-4c1a-bdee-8fcf584bfafe", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} })
93202025-01-30T20:25:31.319ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 518.596004ms iteration = 17 status = {}
93212025-01-30T20:25:31.359ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
93222025-01-30T20:25:31.360ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a7955dd5-6198-41f4-9a08-eb23d1fb9978", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
93232025-01-30T20:25:31.360ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
93242025-01-30T20:25:31.363ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d686dec2-e163-455f-ba39-5975bce6a0cb", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
93252025-01-30T20:25:31.363ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
93262025-01-30T20:25:31.365ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c9a81519-3fbd-48b4-969f-ee6a68a07557", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
93272025-01-30T20:25:31.365ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
93282025-01-30T20:25:31.367ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
93292025-01-30T20:25:31.367ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 565.917167ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
93302025-01-30T20:25:31.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93312025-01-30T20:25:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93322025-01-30T20:25:31.407ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
93332025-01-30T20:25:31.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93342025-01-30T20:25:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93352025-01-30T20:25:31.418ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93362025-01-30T20:25:31.419ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5e02976-a02a-4af3-ba64-808cf96706a9", "content-length": "134", "date": "Thu, 30 Jan 2025 20:25:30 GMT"} })
93372025-01-30T20:25:31.419ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
93382025-01-30T20:25:31.419ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
93392025-01-30T20:25:31.419ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93402025-01-30T20:25:31.419ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93412025-01-30T20:25:31.419ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93422025-01-30T20:25:31.419ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93432025-01-30T20:25:31.419ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93442025-01-30T20:25:31.419ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93452025-01-30T20:25:31.419ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93462025-01-30T20:25:31.419ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93472025-01-30T20:25:31.419ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
93482025-01-30T20:25:31.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93492025-01-30T20:25:31.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93502025-01-30T20:25:31.423ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93512025-01-30T20:25:31.423ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7a0ef3d-cb30-41dc-ac14-c9652bf97df3", "content-length": "2", "date": "Thu, 30 Jan 2025 20:25:30 GMT"} })
93522025-01-30T20:25:31.423ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93532025-01-30T20:25:31.423ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "134e9057-6c37-43b6-9417-535c9a5117bc", "content-length": "52", "date": "Thu, 30 Jan 2025 20:25:30 GMT"} })
93542025-01-30T20:25:31.423ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
93552025-01-30T20:25:31.423ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93562025-01-30T20:25:31.558ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6dd46740-fbb8-4c4a-a66b-26a58f70e416", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} })
93572025-01-30T20:25:31.558ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
93582025-01-30T20:25:31.558ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93592025-01-30T20:25:31.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fb7ca351-0017-4093-9e8c-b02f5bfb2a82 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93602025-01-30T20:25:31.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fb7ca351-0017-4093-9e8c-b02f5bfb2a82 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93612025-01-30T20:25:31.559ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c26214d-109e-48d6-9975-ffef3aa344ff", "content-length": "682", "date": "Thu, 30 Jan 2025 20:25:31 GMT"} })
93622025-01-30T20:25:31.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93632025-01-30T20:25:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93642025-01-30T20:25:31.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fb7ca351-0017-4093-9e8c-b02f5bfb2a82 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93652025-01-30T20:25:31.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93662025-01-30T20:25:31.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93672025-01-30T20:25:31.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93682025-01-30T20:25:31.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93692025-01-30T20:25:31.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93702025-01-30T20:25:31.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93712025-01-30T20:25:31.577ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 776.495051ms iteration = 17 status = {}
93722025-01-30T20:25:31.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = c025486e-5fb2-4ed1-b7c9-e3e6da88257e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
93732025-01-30T20:25:31.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = c025486e-5fb2-4ed1-b7c9-e3e6da88257e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
93742025-01-30T20:25:31.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = c025486e-5fb2-4ed1-b7c9-e3e6da88257e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
93752025-01-30T20:25:32.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 601 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = f20ecdd6-d1dd-4284-89c1-0e14416b5a0c response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
93762025-01-30T20:25:32.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 01ed5680-484c-4097-89f6-a637947dfe6b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93772025-01-30T20:25:32.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 01ed5680-484c-4097-89f6-a637947dfe6b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93782025-01-30T20:25:32.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 01ed5680-484c-4097-89f6-a637947dfe6b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93792025-01-30T20:25:33.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0672f568-70d8-4771-89cd-1591a2f0cb4b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93802025-01-30T20:25:33.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0672f568-70d8-4771-89cd-1591a2f0cb4b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93812025-01-30T20:25:33.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0672f568-70d8-4771-89cd-1591a2f0cb4b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93822025-01-30T20:25:34.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e24ef60e-8516-4346-b742-a2089cfc39e5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93832025-01-30T20:25:34.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e24ef60e-8516-4346-b742-a2089cfc39e5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93842025-01-30T20:25:34.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e24ef60e-8516-4346-b742-a2089cfc39e5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93852025-01-30T20:25:35.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e82d2461-54d5-45bd-807b-972b9a395286 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93862025-01-30T20:25:35.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e82d2461-54d5-45bd-807b-972b9a395286 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93872025-01-30T20:25:35.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e82d2461-54d5-45bd-807b-972b9a395286 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93882025-01-30T20:25:36.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f016a60b-d9eb-42b6-acec-f89598dd3303 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93892025-01-30T20:25:36.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f016a60b-d9eb-42b6-acec-f89598dd3303 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93902025-01-30T20:25:36.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f016a60b-d9eb-42b6-acec-f89598dd3303 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93912025-01-30T20:25:37.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 90d803cb-ae15-4dbf-8fde-1b015907cf06 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93922025-01-30T20:25:37.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 90d803cb-ae15-4dbf-8fde-1b015907cf06 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93932025-01-30T20:25:37.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 90d803cb-ae15-4dbf-8fde-1b015907cf06 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93942025-01-30T20:25:38.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d1b9d732-2086-4567-9be8-5dcae9d7386d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93952025-01-30T20:25:38.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d1b9d732-2086-4567-9be8-5dcae9d7386d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93962025-01-30T20:25:38.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d1b9d732-2086-4567-9be8-5dcae9d7386d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93972025-01-30T20:25:39.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4e68d2ec-7b9f-43be-b3ea-df0adbdaca7f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93982025-01-30T20:25:39.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4e68d2ec-7b9f-43be-b3ea-df0adbdaca7f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
93992025-01-30T20:25:39.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4e68d2ec-7b9f-43be-b3ea-df0adbdaca7f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94002025-01-30T20:25:40.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b0b24330-9b43-4ac2-af71-ca27dcb04296 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94012025-01-30T20:25:40.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b0b24330-9b43-4ac2-af71-ca27dcb04296 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94022025-01-30T20:25:40.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b0b24330-9b43-4ac2-af71-ca27dcb04296 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94032025-01-30T20:25:40.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
94042025-01-30T20:25:40.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
94052025-01-30T20:25:40.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94062025-01-30T20:25:40.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94072025-01-30T20:25:40.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94082025-01-30T20:25:40.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94092025-01-30T20:25:40.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94102025-01-30T20:25:40.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94112025-01-30T20:25:40.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94122025-01-30T20:25:40.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94132025-01-30T20:25:40.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94142025-01-30T20:25:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94152025-01-30T20:25:40.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94162025-01-30T20:25:40.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
94172025-01-30T20:25:40.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94182025-01-30T20:25:40.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94192025-01-30T20:25:40.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
94202025-01-30T20:25:40.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.8227ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
94212025-01-30T20:25:40.831ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94222025-01-30T20:25:40.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94232025-01-30T20:25:40.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.530213ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94242025-01-30T20:25:41.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bd41ce13-4782-4e3a-95c2-a8926b2ef170 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94252025-01-30T20:25:41.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bd41ce13-4782-4e3a-95c2-a8926b2ef170 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94262025-01-30T20:25:41.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bd41ce13-4782-4e3a-95c2-a8926b2ef170 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94272025-01-30T20:25:42.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 100a5e88-593c-4c13-86cf-7e8b5342feab response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
94282025-01-30T20:25:42.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4b241f2b-a58e-426f-ae3a-2296685dfedd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94292025-01-30T20:25:42.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4b241f2b-a58e-426f-ae3a-2296685dfedd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94302025-01-30T20:25:42.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4b241f2b-a58e-426f-ae3a-2296685dfedd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94312025-01-30T20:25:43.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b53910d6-5930-4248-bef9-97bfdc1ed337 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94322025-01-30T20:25:43.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b53910d6-5930-4248-bef9-97bfdc1ed337 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94332025-01-30T20:25:43.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b53910d6-5930-4248-bef9-97bfdc1ed337 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94342025-01-30T20:25:44.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4855cd84-e950-43ee-99b2-bee5fdbf1f91 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94352025-01-30T20:25:44.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4855cd84-e950-43ee-99b2-bee5fdbf1f91 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94362025-01-30T20:25:44.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4855cd84-e950-43ee-99b2-bee5fdbf1f91 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94372025-01-30T20:25:45.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 981c26dc-230f-41d9-ba1a-7dbb3f87b386 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94382025-01-30T20:25:45.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 981c26dc-230f-41d9-ba1a-7dbb3f87b386 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94392025-01-30T20:25:45.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 981c26dc-230f-41d9-ba1a-7dbb3f87b386 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94402025-01-30T20:25:46.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e9cdcf5a-e3ca-45e1-b0f8-856d8a4a7f74 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94412025-01-30T20:25:46.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e9cdcf5a-e3ca-45e1-b0f8-856d8a4a7f74 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94422025-01-30T20:25:46.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e9cdcf5a-e3ca-45e1-b0f8-856d8a4a7f74 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94432025-01-30T20:25:47.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 23a9475d-340c-4dbe-9541-1d3488b87e41 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94442025-01-30T20:25:47.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 23a9475d-340c-4dbe-9541-1d3488b87e41 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94452025-01-30T20:25:47.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 23a9475d-340c-4dbe-9541-1d3488b87e41 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94462025-01-30T20:25:48.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 93dc0da4-7b76-4818-82d3-ad06ad658636 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94472025-01-30T20:25:48.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 93dc0da4-7b76-4818-82d3-ad06ad658636 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94482025-01-30T20:25:48.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 93dc0da4-7b76-4818-82d3-ad06ad658636 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94492025-01-30T20:25:49.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fcec8293-a6ca-4030-8a6b-32fa1f5af3ce roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94502025-01-30T20:25:49.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fcec8293-a6ca-4030-8a6b-32fa1f5af3ce resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94512025-01-30T20:25:49.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fcec8293-a6ca-4030-8a6b-32fa1f5af3ce response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94522025-01-30T20:25:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
94532025-01-30T20:25:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
94542025-01-30T20:25:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94552025-01-30T20:25:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94562025-01-30T20:25:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94572025-01-30T20:25:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94582025-01-30T20:25:50.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94592025-01-30T20:25:50.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94602025-01-30T20:25:50.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94612025-01-30T20:25:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94622025-01-30T20:25:50.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94632025-01-30T20:25:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94642025-01-30T20:25:50.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94652025-01-30T20:25:50.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94662025-01-30T20:25:50.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94672025-01-30T20:25:50.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
94682025-01-30T20:25:50.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94692025-01-30T20:25:50.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94702025-01-30T20:25:50.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
94712025-01-30T20:25:50.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.666784ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
94722025-01-30T20:25:50.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.314589ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94732025-01-30T20:25:50.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8d590428-bd4e-415f-9370-095afabc02fd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94742025-01-30T20:25:50.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8d590428-bd4e-415f-9370-095afabc02fd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94752025-01-30T20:25:50.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8d590428-bd4e-415f-9370-095afabc02fd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94762025-01-30T20:25:52.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 01b1343b-b14e-45da-ba4e-d79b7e4d6d3a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94772025-01-30T20:25:52.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 01b1343b-b14e-45da-ba4e-d79b7e4d6d3a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94782025-01-30T20:25:52.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 01b1343b-b14e-45da-ba4e-d79b7e4d6d3a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94792025-01-30T20:25:52.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 518 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 988ff92f-9bb7-44e5-b486-964696257280 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
94802025-01-30T20:25:53.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8945fe04-fd51-4b9a-b368-ceaf866e49ad roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94812025-01-30T20:25:53.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8945fe04-fd51-4b9a-b368-ceaf866e49ad resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94822025-01-30T20:25:53.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8945fe04-fd51-4b9a-b368-ceaf866e49ad response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94832025-01-30T20:25:54.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6fd28462-7860-40eb-8247-26a8f6d1b51a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94842025-01-30T20:25:54.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6fd28462-7860-40eb-8247-26a8f6d1b51a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94852025-01-30T20:25:54.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6fd28462-7860-40eb-8247-26a8f6d1b51a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94862025-01-30T20:25:55.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2f47ef7b-2d9f-47eb-8ea9-2cbca8309b39 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94872025-01-30T20:25:55.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2f47ef7b-2d9f-47eb-8ea9-2cbca8309b39 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94882025-01-30T20:25:55.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2f47ef7b-2d9f-47eb-8ea9-2cbca8309b39 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94892025-01-30T20:25:56.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 271b423e-3c72-47cf-a6e4-609692b7f830 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94902025-01-30T20:25:56.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 271b423e-3c72-47cf-a6e4-609692b7f830 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94912025-01-30T20:25:56.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2682 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 271b423e-3c72-47cf-a6e4-609692b7f830 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94922025-01-30T20:25:57.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 06d23900-e90c-4138-ad3a-c68cd0161b54 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94932025-01-30T20:25:57.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 06d23900-e90c-4138-ad3a-c68cd0161b54 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94942025-01-30T20:25:57.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 06d23900-e90c-4138-ad3a-c68cd0161b54 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94952025-01-30T20:25:58.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = abf81abb-adda-4f0e-b1d0-7030b4b75a0a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94962025-01-30T20:25:58.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = abf81abb-adda-4f0e-b1d0-7030b4b75a0a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94972025-01-30T20:25:58.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = abf81abb-adda-4f0e-b1d0-7030b4b75a0a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94982025-01-30T20:25:59.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7e9c313-fcd0-4c52-8adc-b5c5cbc374b8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
94992025-01-30T20:25:59.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7e9c313-fcd0-4c52-8adc-b5c5cbc374b8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
95002025-01-30T20:25:59.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7e9c313-fcd0-4c52-8adc-b5c5cbc374b8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
95012025-01-30T20:26:00.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e3639916-764d-4c89-b790-73e4c1aeb331 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
95022025-01-30T20:26:00.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e3639916-764d-4c89-b790-73e4c1aeb331 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
95032025-01-30T20:26:00.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e3639916-764d-4c89-b790-73e4c1aeb331 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
95042025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
95052025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95062025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
95072025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
95082025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
95092025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
95102025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95112025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
95122025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
95132025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
95142025-01-30T20:26:00.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
95152025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95162025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
95172025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
95182025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95192025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
95202025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95212025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
95222025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
95232025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95242025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
95252025-01-30T20:26:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
95262025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
95272025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
95282025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
95292025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
95302025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95312025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
95322025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
95332025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95342025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95352025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
95362025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
95372025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
95382025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95392025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
95402025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
95412025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95422025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
95432025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95442025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
95452025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95462025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95472025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95482025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
95492025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95502025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
95512025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
95522025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
95532025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95542025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95552025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
95562025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
95572025-01-30T20:26:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95582025-01-30T20:26:00.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95592025-01-30T20:26:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95602025-01-30T20:26:00.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95612025-01-30T20:26:00.804ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2712, tv_nsec: 14564811 } })
95622025-01-30T20:26:00.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.347623ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
95632025-01-30T20:26:00.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
95642025-01-30T20:26:00.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.436585ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
95652025-01-30T20:26:00.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95662025-01-30T20:26:00.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95672025-01-30T20:26:00.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95682025-01-30T20:26:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95692025-01-30T20:26:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
95702025-01-30T20:26:00.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95712025-01-30T20:26:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95722025-01-30T20:26:00.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95732025-01-30T20:26:00.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
95742025-01-30T20:26:00.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95752025-01-30T20:26:00.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95762025-01-30T20:26:00.813ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95772025-01-30T20:26:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
95782025-01-30T20:26:00.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95792025-01-30T20:26:00.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95802025-01-30T20:26:00.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95812025-01-30T20:26:00.817ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2712, tv_nsec: 27631494 } })
95822025-01-30T20:26:00.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
95832025-01-30T20:26:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
95842025-01-30T20:26:00.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95852025-01-30T20:26:00.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95862025-01-30T20:26:00.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95872025-01-30T20:26:00.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95882025-01-30T20:26:00.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95892025-01-30T20:26:00.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
95902025-01-30T20:26:00.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
95912025-01-30T20:26:00.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
95922025-01-30T20:26:00.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95932025-01-30T20:26:00.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95942025-01-30T20:26:00.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95952025-01-30T20:26:00.826ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95962025-01-30T20:26:00.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95972025-01-30T20:26:00.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95982025-01-30T20:26:00.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2712, tv_nsec: 36225423 } })
95992025-01-30T20:26:00.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
96002025-01-30T20:26:00.827ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96012025-01-30T20:26:00.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96022025-01-30T20:26:00.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96032025-01-30T20:26:00.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96042025-01-30T20:26:00.847ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96052025-01-30T20:26:00.848ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96062025-01-30T20:26:00.848ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
96072025-01-30T20:26:00.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96082025-01-30T20:26:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96092025-01-30T20:26:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
96102025-01-30T20:26:00.849ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96112025-01-30T20:26:00.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96122025-01-30T20:26:00.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96132025-01-30T20:26:00.851ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96142025-01-30T20:26:00.851ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
96152025-01-30T20:26:00.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96162025-01-30T20:26:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96172025-01-30T20:26:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96182025-01-30T20:26:00.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.52787ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96192025-01-30T20:26:00.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.442296ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
96202025-01-30T20:26:00.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96212025-01-30T20:26:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96222025-01-30T20:26:00.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96232025-01-30T20:26:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96242025-01-30T20:26:00.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96252025-01-30T20:26:00.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96262025-01-30T20:26:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96272025-01-30T20:26:00.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96282025-01-30T20:26:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96292025-01-30T20:26:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
96302025-01-30T20:26:00.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96312025-01-30T20:26:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96322025-01-30T20:26:00.868ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 66.534456ms iteration = 18 status = 0
96332025-01-30T20:26:00.868ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
96342025-01-30T20:26:00.868ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.037171ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
96352025-01-30T20:26:00.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96362025-01-30T20:26:00.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96372025-01-30T20:26:00.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96382025-01-30T20:26:00.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96392025-01-30T20:26:00.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96402025-01-30T20:26:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
96412025-01-30T20:26:00.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96422025-01-30T20:26:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96432025-01-30T20:26:00.883ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
96442025-01-30T20:26:00.883ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
96452025-01-30T20:26:00.883ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a94a342-1216-4d37-9b73-f7dcec3c1aea", "content-length": "26", "date": "Thu, 30 Jan 2025 20:26:00 GMT"} })
96462025-01-30T20:26:00.883ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
96472025-01-30T20:26:00.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.85689ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
96482025-01-30T20:26:00.884ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
96492025-01-30T20:26:00.885ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96502025-01-30T20:26:00.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96512025-01-30T20:26:00.886ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96522025-01-30T20:26:00.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
96532025-01-30T20:26:00.889ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96542025-01-30T20:26:00.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96552025-01-30T20:26:00.890ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
96562025-01-30T20:26:00.890ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 88.805854ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
96572025-01-30T20:26:00.891ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96582025-01-30T20:26:00.892ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
96592025-01-30T20:26:00.892ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.167183ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
96602025-01-30T20:26:00.893ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
96612025-01-30T20:26:00.893ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.911151ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
96622025-01-30T20:26:00.896ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
96632025-01-30T20:26:00.896ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
96642025-01-30T20:26:00.896ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7967d9e0-06fc-4c4f-a430-33f7a47122b7", "content-length": "26", "date": "Thu, 30 Jan 2025 20:26:00 GMT"} })
96652025-01-30T20:26:00.896ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
96662025-01-30T20:26:00.898ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
96672025-01-30T20:26:00.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.273863ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
96682025-01-30T20:26:00.904ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
96692025-01-30T20:26:00.904ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
96702025-01-30T20:26:00.904ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "75a3970b-8da4-44b1-bf57-0fa111851bad", "content-length": "26", "date": "Thu, 30 Jan 2025 20:26:00 GMT"} })
96712025-01-30T20:26:00.904ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
96722025-01-30T20:26:00.906ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
96732025-01-30T20:26:00.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 109.581001ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
96742025-01-30T20:26:00.916ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 114.5569ms iteration = 20 status = {"physical_disks_added":0}
96752025-01-30T20:26:00.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96762025-01-30T20:26:00.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96772025-01-30T20:26:00.989ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 187.546105ms iteration = 18 status = {}
96782025-01-30T20:26:01.002ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
96792025-01-30T20:26:01.002ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
96802025-01-30T20:26:01.002ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "53840339-39b7-4316-9c90-df757aa471f3", "content-length": "372", "date": "Thu, 30 Jan 2025 20:26:01 GMT"} })
96812025-01-30T20:26:01.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96822025-01-30T20:26:01.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96832025-01-30T20:26:01.004ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
96842025-01-30T20:26:01.004ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e73cdfb7-b479-4248-aff6-ea059f8fa9b4", "content-length": "1", "date": "Thu, 30 Jan 2025 20:26:00 GMT"} })
96852025-01-30T20:26:01.006ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96862025-01-30T20:26:01.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96872025-01-30T20:26:01.008ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 206.786899ms iteration = 18 status = null
96882025-01-30T20:26:01.052ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
96892025-01-30T20:26:01.052ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
96902025-01-30T20:26:01.052ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "42bd36d2-df1f-4fed-b715-86300696d6f5", "date": "Thu, 30 Jan 2025 20:26:01 GMT"} })
96912025-01-30T20:26:01.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96922025-01-30T20:26:01.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96932025-01-30T20:26:01.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96942025-01-30T20:26:01.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96952025-01-30T20:26:01.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96962025-01-30T20:26:01.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96972025-01-30T20:26:01.062ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
96982025-01-30T20:26:01.062ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
96992025-01-30T20:26:01.063ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "58bbb114-37fb-41ff-a065-202047b3c340", "date": "Thu, 30 Jan 2025 20:26:01 GMT"} })
97002025-01-30T20:26:01.064ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 262.892227ms iteration = 18 status = {}
97012025-01-30T20:26:01.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97022025-01-30T20:26:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97032025-01-30T20:26:01.073ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
97042025-01-30T20:26:01.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97052025-01-30T20:26:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97062025-01-30T20:26:01.082ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
97072025-01-30T20:26:01.082ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c247c679-8d97-41d9-af54-3fd9c36642ce", "content-length": "134", "date": "Thu, 30 Jan 2025 20:26:00 GMT"} })
97082025-01-30T20:26:01.082ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
97092025-01-30T20:26:01.083ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
97102025-01-30T20:26:01.083ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
97112025-01-30T20:26:01.083ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
97122025-01-30T20:26:01.083ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97132025-01-30T20:26:01.083ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97142025-01-30T20:26:01.083ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97152025-01-30T20:26:01.083ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
97162025-01-30T20:26:01.083ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97172025-01-30T20:26:01.083ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
97182025-01-30T20:26:01.083ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
97192025-01-30T20:26:01.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97202025-01-30T20:26:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97212025-01-30T20:26:01.085ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
97222025-01-30T20:26:01.086ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "98c0d776-1cef-4e2f-ad7e-a0008e11391c", "content-length": "2", "date": "Thu, 30 Jan 2025 20:26:00 GMT"} })
97232025-01-30T20:26:01.086ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
97242025-01-30T20:26:01.086ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c621f6d2-9597-49e4-9105-d7b646e57fcf", "content-length": "52", "date": "Thu, 30 Jan 2025 20:26:00 GMT"} })
97252025-01-30T20:26:01.086ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
97262025-01-30T20:26:01.086ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
97272025-01-30T20:26:01.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97282025-01-30T20:26:01.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97292025-01-30T20:26:01.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97302025-01-30T20:26:01.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97312025-01-30T20:26:01.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97322025-01-30T20:26:01.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97332025-01-30T20:26:01.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97342025-01-30T20:26:01.108ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97352025-01-30T20:26:01.108ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97362025-01-30T20:26:01.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97372025-01-30T20:26:01.141ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
97382025-01-30T20:26:01.218ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7c6f23d6-b076-4f91-9fa8-07e314160f1b", "date": "Thu, 30 Jan 2025 20:26:01 GMT"} })
97392025-01-30T20:26:01.218ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
97402025-01-30T20:26:01.218ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
97412025-01-30T20:26:01.218ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6324e20d-97ac-45ff-bae2-1258d639f4e1", "content-length": "691", "date": "Thu, 30 Jan 2025 20:26:01 GMT"} })
97422025-01-30T20:26:01.218ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
97432025-01-30T20:26:01.218ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
97442025-01-30T20:26:01.218ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
97452025-01-30T20:26:01.218ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ade8ab24-6cff-45cf-af75-a26bf6985e23", "content-length": "682", "date": "Thu, 30 Jan 2025 20:26:01 GMT"} })
97462025-01-30T20:26:01.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97472025-01-30T20:26:01.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97482025-01-30T20:26:01.220ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 418.162045ms iteration = 18 status = {}
97492025-01-30T20:26:01.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97502025-01-30T20:26:01.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97512025-01-30T20:26:01.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97522025-01-30T20:26:01.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97532025-01-30T20:26:01.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97542025-01-30T20:26:01.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97552025-01-30T20:26:01.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = eb38f91f-675f-4642-8e09-d51ad509929a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97562025-01-30T20:26:01.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = eb38f91f-675f-4642-8e09-d51ad509929a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97572025-01-30T20:26:01.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = eb38f91f-675f-4642-8e09-d51ad509929a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97582025-01-30T20:26:01.236ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 434.184341ms iteration = 18 status = {}
97592025-01-30T20:26:01.542ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
97602025-01-30T20:26:01.542ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
97612025-01-30T20:26:01.573ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
97622025-01-30T20:26:01.573ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:40482
97632025-01-30T20:26:01.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40482 req_id = 8c99620a-9db2-4b07-82c8-abcd6181820a roles = RoleSet { roles: {} } uri = /metrics/producers
97642025-01-30T20:26:01.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40482 req_id = 8c99620a-9db2-4b07-82c8-abcd6181820a resource = Database result = Ok(()) uri = /metrics/producers
97652025-01-30T20:26:01.610ZINFOnexus: assigned collector to new producer collector_id = 623434f7-1950-4ff8-a21d-872e401e4248 file = nexus/src/app/oximeter.rs:76 producer_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
97662025-01-30T20:26:01.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37033 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40482 req_id = 8c99620a-9db2-4b07-82c8-abcd6181820a response_code = 201 uri = /metrics/producers
97672025-01-30T20:26:01.610ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "8c99620a-9db2-4b07-82c8-abcd6181820a", "content-length": "41", "date": "Thu, 30 Jan 2025 20:26:01 GMT"} })
97682025-01-30T20:26:01.613ZDEBGnexus (producer-registration-task): registered with nexus successfully
97692025-01-30T20:26:01.613ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
97702025-01-30T20:26:01.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 188844ed-75cf-4a85-9b24-3c478885fce4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
97712025-01-30T20:26:01.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 188844ed-75cf-4a85-9b24-3c478885fce4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
97722025-01-30T20:26:01.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 188844ed-75cf-4a85-9b24-3c478885fce4 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
97732025-01-30T20:26:02.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fcf5e6c8-f8fa-4236-9bfd-6b28adc18785 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97742025-01-30T20:26:02.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fcf5e6c8-f8fa-4236-9bfd-6b28adc18785 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97752025-01-30T20:26:02.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fcf5e6c8-f8fa-4236-9bfd-6b28adc18785 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97762025-01-30T20:26:02.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 6d55d52f-93f3-4fd9-abd4-100c7a7ae773 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
97772025-01-30T20:26:02.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 6d55d52f-93f3-4fd9-abd4-100c7a7ae773 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
97782025-01-30T20:26:02.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 6d55d52f-93f3-4fd9-abd4-100c7a7ae773 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
97792025-01-30T20:26:02.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 50897dc2-9376-4d26-9905-8cb99ad88eaa roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
97802025-01-30T20:26:02.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 50897dc2-9376-4d26-9905-8cb99ad88eaa resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
97812025-01-30T20:26:02.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 50897dc2-9376-4d26-9905-8cb99ad88eaa response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
97822025-01-30T20:26:02.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 511 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 3ec55775-7122-45a3-9658-339d0baa83a0 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
97832025-01-30T20:26:03.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 763263ec-94a2-44a3-b3c3-31d151b3921d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97842025-01-30T20:26:03.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 763263ec-94a2-44a3-b3c3-31d151b3921d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97852025-01-30T20:26:03.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 763263ec-94a2-44a3-b3c3-31d151b3921d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97862025-01-30T20:26:04.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 46a98e7e-aada-4166-9201-e0a65f40a456 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97872025-01-30T20:26:04.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 46a98e7e-aada-4166-9201-e0a65f40a456 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97882025-01-30T20:26:04.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 46a98e7e-aada-4166-9201-e0a65f40a456 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97892025-01-30T20:26:05.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b1999ae0-3dae-4718-8a68-b6e79a709db4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97902025-01-30T20:26:05.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b1999ae0-3dae-4718-8a68-b6e79a709db4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97912025-01-30T20:26:05.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b1999ae0-3dae-4718-8a68-b6e79a709db4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97922025-01-30T20:26:06.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c7f185ae-d0d1-4b77-851d-d30436044f92 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97932025-01-30T20:26:06.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c7f185ae-d0d1-4b77-851d-d30436044f92 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97942025-01-30T20:26:06.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c7f185ae-d0d1-4b77-851d-d30436044f92 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97952025-01-30T20:26:07.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7e16a4d-df77-418b-ad4c-0c039b6d0af9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97962025-01-30T20:26:07.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7e16a4d-df77-418b-ad4c-0c039b6d0af9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97972025-01-30T20:26:07.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7e16a4d-df77-418b-ad4c-0c039b6d0af9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97982025-01-30T20:26:08.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = eb7f8129-1a35-4c7e-8035-b8fa5a7a4aa3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
97992025-01-30T20:26:08.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = eb7f8129-1a35-4c7e-8035-b8fa5a7a4aa3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98002025-01-30T20:26:08.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = eb7f8129-1a35-4c7e-8035-b8fa5a7a4aa3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98012025-01-30T20:26:09.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e52353d6-32f9-4f9b-8557-c8335d938ecc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98022025-01-30T20:26:09.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e52353d6-32f9-4f9b-8557-c8335d938ecc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98032025-01-30T20:26:09.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e52353d6-32f9-4f9b-8557-c8335d938ecc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98042025-01-30T20:26:10.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 692122a2-db46-439f-b1fa-17d455a5343b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98052025-01-30T20:26:10.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 692122a2-db46-439f-b1fa-17d455a5343b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98062025-01-30T20:26:10.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 692122a2-db46-439f-b1fa-17d455a5343b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98072025-01-30T20:26:10.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
98082025-01-30T20:26:10.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
98092025-01-30T20:26:10.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98102025-01-30T20:26:10.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98112025-01-30T20:26:10.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98122025-01-30T20:26:10.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98132025-01-30T20:26:10.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98142025-01-30T20:26:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98152025-01-30T20:26:10.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98162025-01-30T20:26:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98172025-01-30T20:26:10.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98182025-01-30T20:26:10.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98192025-01-30T20:26:10.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98202025-01-30T20:26:10.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
98212025-01-30T20:26:10.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98222025-01-30T20:26:10.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98232025-01-30T20:26:10.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
98242025-01-30T20:26:10.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.923428ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
98252025-01-30T20:26:10.829ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98262025-01-30T20:26:10.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98272025-01-30T20:26:10.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.731126ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98282025-01-30T20:26:11.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1434a6e1-0e7b-4be0-8af7-c4b634253989 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98292025-01-30T20:26:11.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1434a6e1-0e7b-4be0-8af7-c4b634253989 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98302025-01-30T20:26:11.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1434a6e1-0e7b-4be0-8af7-c4b634253989 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98312025-01-30T20:26:12.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 497 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 4bfd2975-4180-46ab-aaa3-c638059ae7c3 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
98322025-01-30T20:26:12.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d31c4a5b-05ab-43dd-a2f1-31836bcfcf84 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98332025-01-30T20:26:12.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d31c4a5b-05ab-43dd-a2f1-31836bcfcf84 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98342025-01-30T20:26:12.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d31c4a5b-05ab-43dd-a2f1-31836bcfcf84 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98352025-01-30T20:26:13.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8d6b490c-adbd-4675-b503-21b974c890c2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98362025-01-30T20:26:13.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8d6b490c-adbd-4675-b503-21b974c890c2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98372025-01-30T20:26:13.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8d6b490c-adbd-4675-b503-21b974c890c2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98382025-01-30T20:26:14.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f3e4e5a6-43cc-43d0-9ed6-e64076d0c722 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98392025-01-30T20:26:14.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f3e4e5a6-43cc-43d0-9ed6-e64076d0c722 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98402025-01-30T20:26:14.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f3e4e5a6-43cc-43d0-9ed6-e64076d0c722 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98412025-01-30T20:26:15.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 501ed6ba-c217-4cdc-93a5-64395e95abb8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98422025-01-30T20:26:15.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 501ed6ba-c217-4cdc-93a5-64395e95abb8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98432025-01-30T20:26:15.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 501ed6ba-c217-4cdc-93a5-64395e95abb8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98442025-01-30T20:26:16.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ead3535a-6efc-42b9-8699-89eba4ae53f2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98452025-01-30T20:26:16.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ead3535a-6efc-42b9-8699-89eba4ae53f2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98462025-01-30T20:26:16.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ead3535a-6efc-42b9-8699-89eba4ae53f2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98472025-01-30T20:26:17.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 66c32248-04cc-4f54-9a4a-28fc107f5c6d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98482025-01-30T20:26:17.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 66c32248-04cc-4f54-9a4a-28fc107f5c6d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98492025-01-30T20:26:17.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 66c32248-04cc-4f54-9a4a-28fc107f5c6d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98502025-01-30T20:26:18.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4d544b11-d8d6-4d97-b16b-7a4afc1ad4a0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98512025-01-30T20:26:18.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4d544b11-d8d6-4d97-b16b-7a4afc1ad4a0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98522025-01-30T20:26:18.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4d544b11-d8d6-4d97-b16b-7a4afc1ad4a0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98532025-01-30T20:26:19.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fe7c0428-eda5-44e5-9863-443fce3de41b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98542025-01-30T20:26:19.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fe7c0428-eda5-44e5-9863-443fce3de41b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98552025-01-30T20:26:19.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fe7c0428-eda5-44e5-9863-443fce3de41b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98562025-01-30T20:26:20.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a8735ec1-7f2e-42e3-8465-230e48d984a0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98572025-01-30T20:26:20.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a8735ec1-7f2e-42e3-8465-230e48d984a0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98582025-01-30T20:26:20.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a8735ec1-7f2e-42e3-8465-230e48d984a0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98592025-01-30T20:26:20.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
98602025-01-30T20:26:20.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98612025-01-30T20:26:20.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
98622025-01-30T20:26:20.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98632025-01-30T20:26:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98642025-01-30T20:26:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98652025-01-30T20:26:20.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98662025-01-30T20:26:20.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98672025-01-30T20:26:20.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98682025-01-30T20:26:20.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.807016ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98692025-01-30T20:26:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98702025-01-30T20:26:20.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98712025-01-30T20:26:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98722025-01-30T20:26:20.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98732025-01-30T20:26:20.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98742025-01-30T20:26:20.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98752025-01-30T20:26:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
98762025-01-30T20:26:20.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98772025-01-30T20:26:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98782025-01-30T20:26:20.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
98792025-01-30T20:26:20.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.862382ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
98802025-01-30T20:26:21.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9bf5c32c-004d-4c56-b03f-054e79658cc6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98812025-01-30T20:26:21.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9bf5c32c-004d-4c56-b03f-054e79658cc6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98822025-01-30T20:26:21.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9bf5c32c-004d-4c56-b03f-054e79658cc6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98832025-01-30T20:26:22.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 572 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 9a17a475-7eaa-4575-b2eb-aecfe171a3fb response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
98842025-01-30T20:26:22.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cdedf11a-5c60-4a3f-95b6-426108a2b664 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98852025-01-30T20:26:22.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cdedf11a-5c60-4a3f-95b6-426108a2b664 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98862025-01-30T20:26:22.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cdedf11a-5c60-4a3f-95b6-426108a2b664 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98872025-01-30T20:26:23.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dc5c03bf-f814-4827-9e86-7225b2cadafa roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98882025-01-30T20:26:23.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dc5c03bf-f814-4827-9e86-7225b2cadafa resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98892025-01-30T20:26:23.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dc5c03bf-f814-4827-9e86-7225b2cadafa response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98902025-01-30T20:26:24.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e2e9413c-5bfa-43c6-91f3-2e40ccb83651 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98912025-01-30T20:26:24.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e2e9413c-5bfa-43c6-91f3-2e40ccb83651 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98922025-01-30T20:26:24.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e2e9413c-5bfa-43c6-91f3-2e40ccb83651 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98932025-01-30T20:26:25.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5bb9da1c-94b9-44ca-b95a-4a97313502ed roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98942025-01-30T20:26:25.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5bb9da1c-94b9-44ca-b95a-4a97313502ed resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98952025-01-30T20:26:25.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5bb9da1c-94b9-44ca-b95a-4a97313502ed response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98962025-01-30T20:26:26.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7e85364-a8ae-441d-9263-9a25bf537b3b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98972025-01-30T20:26:26.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7e85364-a8ae-441d-9263-9a25bf537b3b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98982025-01-30T20:26:26.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7e85364-a8ae-441d-9263-9a25bf537b3b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
98992025-01-30T20:26:27.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cd467b3d-7fc9-4f62-a2c6-4f1770dee31b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
99002025-01-30T20:26:27.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cd467b3d-7fc9-4f62-a2c6-4f1770dee31b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
99012025-01-30T20:26:27.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cd467b3d-7fc9-4f62-a2c6-4f1770dee31b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
99022025-01-30T20:26:28.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fa1315da-0e8c-4248-886c-99ef420fc5fc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
99032025-01-30T20:26:28.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fa1315da-0e8c-4248-886c-99ef420fc5fc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
99042025-01-30T20:26:28.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fa1315da-0e8c-4248-886c-99ef420fc5fc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
99052025-01-30T20:26:29.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3e5b11e8-2d14-461a-b083-2c82156d800e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
99062025-01-30T20:26:29.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3e5b11e8-2d14-461a-b083-2c82156d800e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
99072025-01-30T20:26:29.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3e5b11e8-2d14-461a-b083-2c82156d800e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
99082025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
99092025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
99102025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99112025-01-30T20:26:30.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:16:30.801131568 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
99122025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
99132025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
99142025-01-30T20:26:30.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
99152025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
99162025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
99172025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.44\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
99182025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99192025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
99202025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
99212025-01-30T20:26:30.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
99222025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
99232025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99242025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
99252025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
99262025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99272025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
99282025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
99292025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99302025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
99312025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
99322025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
99332025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
99342025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
99352025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
99362025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
99372025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
99382025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
99392025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
99402025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
99412025-01-30T20:26:30.801ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
99422025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
99432025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
99442025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
99452025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
99462025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
99472025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
99482025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
99492025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
99502025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99512025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
99522025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
99532025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
99542025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
99552025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99562025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
99572025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
99582025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
99592025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
99602025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
99612025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99622025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
99632025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99642025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
99652025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
99662025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99672025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
99682025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
99692025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99702025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
99712025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
99722025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
99732025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99742025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99752025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
99762025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99772025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99782025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99792025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
99802025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99812025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
99822025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
99832025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
99842025-01-30T20:26:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
99852025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
99862025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
99872025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
99882025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
99892025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
99902025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
99912025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
99922025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99932025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99942025-01-30T20:26:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2742, tv_nsec: 11656021 } })
99952025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99962025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
99972025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99982025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99992025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100002025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100012025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100022025-01-30T20:26:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2742, tv_nsec: 11776574 } })
100032025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100042025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100052025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100062025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100072025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
100082025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.133022ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
100092025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100102025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100112025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
100122025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.181283ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
100132025-01-30T20:26:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100142025-01-30T20:26:30.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100152025-01-30T20:26:30.804ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:16:30.801131568 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
100162025-01-30T20:26:30.804ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.981333ms iteration = 10 status = {"expiration":"2025-01-30T20:16:30.801131568Z","pruned":[]}
100172025-01-30T20:26:30.804ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.754246ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100182025-01-30T20:26:30.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100192025-01-30T20:26:30.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100202025-01-30T20:26:30.804ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100212025-01-30T20:26:30.804ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
100222025-01-30T20:26:30.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100232025-01-30T20:26:30.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100242025-01-30T20:26:30.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2742, tv_nsec: 14990914 } })
100252025-01-30T20:26:30.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
100262025-01-30T20:26:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100272025-01-30T20:26:30.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100282025-01-30T20:26:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100292025-01-30T20:26:30.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100302025-01-30T20:26:30.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2742, tv_nsec: 18611354 } })
100312025-01-30T20:26:30.809ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100322025-01-30T20:26:30.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
100332025-01-30T20:26:30.810ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100342025-01-30T20:26:30.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100352025-01-30T20:26:30.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100362025-01-30T20:26:30.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100372025-01-30T20:26:30.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
100382025-01-30T20:26:30.811ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100392025-01-30T20:26:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100402025-01-30T20:26:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
100412025-01-30T20:26:30.812ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
100422025-01-30T20:26:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100432025-01-30T20:26:30.814ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100442025-01-30T20:26:30.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100452025-01-30T20:26:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100462025-01-30T20:26:30.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100472025-01-30T20:26:30.815ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.100281ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
100482025-01-30T20:26:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
100492025-01-30T20:26:30.816ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
100502025-01-30T20:26:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
100512025-01-30T20:26:30.816ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
100522025-01-30T20:26:30.816ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
100532025-01-30T20:26:30.816ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.259723ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
100542025-01-30T20:26:30.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100552025-01-30T20:26:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
100562025-01-30T20:26:30.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100572025-01-30T20:26:30.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100582025-01-30T20:26:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100592025-01-30T20:26:30.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100602025-01-30T20:26:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100612025-01-30T20:26:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100622025-01-30T20:26:30.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100632025-01-30T20:26:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100642025-01-30T20:26:30.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
100652025-01-30T20:26:30.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100662025-01-30T20:26:30.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100672025-01-30T20:26:30.824ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100682025-01-30T20:26:30.825ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100692025-01-30T20:26:30.826ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
100702025-01-30T20:26:30.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100712025-01-30T20:26:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100722025-01-30T20:26:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
100732025-01-30T20:26:30.827ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100742025-01-30T20:26:30.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100752025-01-30T20:26:30.828ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100762025-01-30T20:26:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
100772025-01-30T20:26:30.830ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100782025-01-30T20:26:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100792025-01-30T20:26:30.831ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100802025-01-30T20:26:30.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.266891ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100812025-01-30T20:26:30.831ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100822025-01-30T20:26:30.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100832025-01-30T20:26:30.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100842025-01-30T20:26:30.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100852025-01-30T20:26:30.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
100862025-01-30T20:26:30.833ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100872025-01-30T20:26:30.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100882025-01-30T20:26:30.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100892025-01-30T20:26:30.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100902025-01-30T20:26:30.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100912025-01-30T20:26:30.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100922025-01-30T20:26:30.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100932025-01-30T20:26:30.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100942025-01-30T20:26:30.839ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2742, tv_nsec: 48820842 } })
100952025-01-30T20:26:30.839ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
100962025-01-30T20:26:30.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
100972025-01-30T20:26:30.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
100982025-01-30T20:26:30.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.567109ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
100992025-01-30T20:26:30.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.058983ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
101002025-01-30T20:26:30.845ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101012025-01-30T20:26:30.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101022025-01-30T20:26:30.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101032025-01-30T20:26:30.846ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101042025-01-30T20:26:30.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101052025-01-30T20:26:30.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101062025-01-30T20:26:30.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101072025-01-30T20:26:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
101082025-01-30T20:26:30.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101092025-01-30T20:26:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101102025-01-30T20:26:30.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101112025-01-30T20:26:30.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101122025-01-30T20:26:30.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101132025-01-30T20:26:30.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101142025-01-30T20:26:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101152025-01-30T20:26:30.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101162025-01-30T20:26:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101172025-01-30T20:26:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
101182025-01-30T20:26:30.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101192025-01-30T20:26:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101202025-01-30T20:26:30.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101212025-01-30T20:26:30.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101222025-01-30T20:26:30.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.924085ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101232025-01-30T20:26:30.876ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 75.406423ms iteration = 21 status = {"physical_disks_added":0}
101242025-01-30T20:26:30.877ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101252025-01-30T20:26:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101262025-01-30T20:26:30.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101272025-01-30T20:26:30.879ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
101282025-01-30T20:26:30.879ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.205901ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
101292025-01-30T20:26:30.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.106158ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101302025-01-30T20:26:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101312025-01-30T20:26:30.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101322025-01-30T20:26:30.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101332025-01-30T20:26:30.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101342025-01-30T20:26:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101352025-01-30T20:26:30.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e967092b-0bdc-47f7-8c01-c5c1ea2c6db8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
101362025-01-30T20:26:30.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e967092b-0bdc-47f7-8c01-c5c1ea2c6db8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
101372025-01-30T20:26:30.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e967092b-0bdc-47f7-8c01-c5c1ea2c6db8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
101382025-01-30T20:26:30.894ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101392025-01-30T20:26:30.894ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101402025-01-30T20:26:30.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101412025-01-30T20:26:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101422025-01-30T20:26:30.895ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101432025-01-30T20:26:30.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
101442025-01-30T20:26:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
101452025-01-30T20:26:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 95.346056ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
101462025-01-30T20:26:30.896ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101472025-01-30T20:26:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101482025-01-30T20:26:30.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101492025-01-30T20:26:30.897ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101502025-01-30T20:26:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101512025-01-30T20:26:30.899ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101522025-01-30T20:26:30.899ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
101532025-01-30T20:26:30.899ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
101542025-01-30T20:26:30.899ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
101552025-01-30T20:26:30.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101562025-01-30T20:26:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101572025-01-30T20:26:30.900ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 99.007778ms iteration = 5 status = {"nsuccess":5}
101582025-01-30T20:26:30.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
101592025-01-30T20:26:30.901ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101602025-01-30T20:26:30.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101612025-01-30T20:26:30.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101622025-01-30T20:26:30.902ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101632025-01-30T20:26:30.902ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 101.236529ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101642025-01-30T20:26:30.903ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
101652025-01-30T20:26:30.903ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 101.997251ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
101662025-01-30T20:26:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
101672025-01-30T20:26:30.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101682025-01-30T20:26:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101692025-01-30T20:26:30.907ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
101702025-01-30T20:26:30.907ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
101712025-01-30T20:26:30.907ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 106.590899ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
101722025-01-30T20:26:30.907ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
101732025-01-30T20:26:30.907ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
101742025-01-30T20:26:30.907ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
101752025-01-30T20:26:30.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101762025-01-30T20:26:30.908ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101772025-01-30T20:26:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101782025-01-30T20:26:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101792025-01-30T20:26:30.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101802025-01-30T20:26:30.909ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101812025-01-30T20:26:30.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
101822025-01-30T20:26:30.912ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101832025-01-30T20:26:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101842025-01-30T20:26:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
101852025-01-30T20:26:30.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101862025-01-30T20:26:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101872025-01-30T20:26:30.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101882025-01-30T20:26:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101892025-01-30T20:26:30.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101902025-01-30T20:26:30.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101912025-01-30T20:26:30.917ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101922025-01-30T20:26:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
101932025-01-30T20:26:30.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101942025-01-30T20:26:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101952025-01-30T20:26:30.922ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.005738ms iteration = 19 status = 0
101962025-01-30T20:26:30.945ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101972025-01-30T20:26:30.945ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
101982025-01-30T20:26:30.945ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 144.11763ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
101992025-01-30T20:26:30.946ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
102002025-01-30T20:26:30.946ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
102012025-01-30T20:26:30.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102022025-01-30T20:26:30.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102032025-01-30T20:26:30.951ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
102042025-01-30T20:26:30.951ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
102052025-01-30T20:26:30.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102062025-01-30T20:26:30.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102072025-01-30T20:26:30.959ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) }
102082025-01-30T20:26:30.959ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 157.584413ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
102092025-01-30T20:26:30.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102102025-01-30T20:26:30.960ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
102112025-01-30T20:26:30.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102122025-01-30T20:26:30.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102132025-01-30T20:26:30.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102142025-01-30T20:26:30.970ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102152025-01-30T20:26:30.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102162025-01-30T20:26:30.970ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
102172025-01-30T20:26:30.970ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102182025-01-30T20:26:30.970ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e2fec41-48d3-4919-9a02-336cf710aee0", "content-length": "26", "date": "Thu, 30 Jan 2025 20:26:30 GMT"} })
102192025-01-30T20:26:30.970ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102202025-01-30T20:26:30.973ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102212025-01-30T20:26:30.973ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
102222025-01-30T20:26:30.973ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 172.021754ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
102232025-01-30T20:26:30.995ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
102242025-01-30T20:26:30.995ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102252025-01-30T20:26:30.996ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fe13090-e9af-45b8-8fea-b9779a1ae132", "content-length": "26", "date": "Thu, 30 Jan 2025 20:26:30 GMT"} })
102262025-01-30T20:26:30.996ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102272025-01-30T20:26:30.997ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
102282025-01-30T20:26:31.122ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
102292025-01-30T20:26:31.132ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
102302025-01-30T20:26:31.163ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
102312025-01-30T20:26:31.163ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d519c1a-5ad5-4cf5-baea-57ca17be472f", "content-length": "1", "date": "Thu, 30 Jan 2025 20:26:30 GMT"} })
102322025-01-30T20:26:31.165ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102332025-01-30T20:26:31.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102342025-01-30T20:26:31.195ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
102352025-01-30T20:26:31.195ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102362025-01-30T20:26:31.195ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "740d8d47-1918-45fc-9362-15354469fbb7", "content-length": "26", "date": "Thu, 30 Jan 2025 20:26:30 GMT"} })
102372025-01-30T20:26:31.195ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102382025-01-30T20:26:31.201ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102392025-01-30T20:26:31.290ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102402025-01-30T20:26:31.290ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102412025-01-30T20:26:31.291ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "57684573-c621-414a-bc4c-4e9938ebfca0", "content-length": "372", "date": "Thu, 30 Jan 2025 20:26:31 GMT"} })
102422025-01-30T20:26:31.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102432025-01-30T20:26:31.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102442025-01-30T20:26:31.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102452025-01-30T20:26:31.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102462025-01-30T20:26:31.297ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
102472025-01-30T20:26:31.298ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
102482025-01-30T20:26:31.298ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-30 20:18:12.536035 UTC dns_group = internal generation = 1
102492025-01-30T20:26:31.298ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 496.480219ms iteration = 10 status = {"generation":1}
102502025-01-30T20:26:31.298ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 497.419205ms iteration = 19 status = null
102512025-01-30T20:26:31.300ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102522025-01-30T20:26:31.300ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102532025-01-30T20:26:31.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102542025-01-30T20:26:31.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102552025-01-30T20:26:31.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102562025-01-30T20:26:31.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102572025-01-30T20:26:31.310ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
102582025-01-30T20:26:31.310ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
102592025-01-30T20:26:31.310ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-30 20:18:13.133071 UTC dns_group = external generation = 2
102602025-01-30T20:26:31.310ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 509.244274ms iteration = 10 status = {"generation":2}
102612025-01-30T20:26:31.312ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
102622025-01-30T20:26:31.312ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "63d64661-1af9-4400-9c2d-7c6e7780bf81", "date": "Thu, 30 Jan 2025 20:26:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
102632025-01-30T20:26:31.312ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
102642025-01-30T20:26:31.314ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "05020917-3000-417e-99ba-d7b653c80e3b", "date": "Thu, 30 Jan 2025 20:26:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
102652025-01-30T20:26:31.314ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
102662025-01-30T20:26:31.316ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ecedb851-acea-44db-a3a3-f764cde0387c", "date": "Thu, 30 Jan 2025 20:26:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
102672025-01-30T20:26:31.316ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
102682025-01-30T20:26:31.319ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
102692025-01-30T20:26:31.319ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 517.908625ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
102702025-01-30T20:26:31.338ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102712025-01-30T20:26:31.340ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102722025-01-30T20:26:31.340ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102732025-01-30T20:26:31.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102742025-01-30T20:26:31.344ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
102752025-01-30T20:26:31.345ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "586b3eb8-09f8-47cf-8eba-b8fa7b1077e4", "date": "Thu, 30 Jan 2025 20:26:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102762025-01-30T20:26:31.345ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102772025-01-30T20:26:31.347ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "024d1c76-274f-4215-8ddd-34da83692ec5", "date": "Thu, 30 Jan 2025 20:26:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102782025-01-30T20:26:31.347ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102792025-01-30T20:26:31.350ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102802025-01-30T20:26:31.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 549.053258ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
102812025-01-30T20:26:31.353ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
102822025-01-30T20:26:31.353ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102832025-01-30T20:26:31.353ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3d01fd37-e34d-49a0-999a-1481fe5b023a", "date": "Thu, 30 Jan 2025 20:26:31 GMT"} })
102842025-01-30T20:26:31.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102852025-01-30T20:26:31.354ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 552.829754ms iteration = 19 status = {}
102862025-01-30T20:26:31.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102872025-01-30T20:26:31.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102882025-01-30T20:26:31.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102892025-01-30T20:26:31.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102902025-01-30T20:26:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102912025-01-30T20:26:31.413ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102922025-01-30T20:26:31.413ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "da1a220a-677a-4d21-a12d-dc63ca106b90", "content-length": "691", "date": "Thu, 30 Jan 2025 20:26:31 GMT"} })
102932025-01-30T20:26:31.413ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
102942025-01-30T20:26:31.413ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
102952025-01-30T20:26:31.413ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
102962025-01-30T20:26:31.415ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 614.084454ms iteration = 19 status = {}
102972025-01-30T20:26:31.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102982025-01-30T20:26:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102992025-01-30T20:26:31.418ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
103002025-01-30T20:26:31.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103012025-01-30T20:26:31.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103022025-01-30T20:26:31.420ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103032025-01-30T20:26:31.420ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103042025-01-30T20:26:31.420ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7fdc6956-9bdf-404d-baed-11e8511b58ab", "date": "Thu, 30 Jan 2025 20:26:31 GMT"} })
103052025-01-30T20:26:31.423ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 622.153157ms iteration = 19 status = {}
103062025-01-30T20:26:31.429ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103072025-01-30T20:26:31.430ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "20a1a626-c7d8-4805-9974-62aed4c2829c", "content-length": "134", "date": "Thu, 30 Jan 2025 20:26:30 GMT"} })
103082025-01-30T20:26:31.430ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103092025-01-30T20:26:31.430ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
103102025-01-30T20:26:31.430ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103112025-01-30T20:26:31.430ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103122025-01-30T20:26:31.430ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103132025-01-30T20:26:31.430ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103142025-01-30T20:26:31.430ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103152025-01-30T20:26:31.430ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103162025-01-30T20:26:31.430ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103172025-01-30T20:26:31.430ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103182025-01-30T20:26:31.430ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
103192025-01-30T20:26:31.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103202025-01-30T20:26:31.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103212025-01-30T20:26:31.433ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103222025-01-30T20:26:31.433ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a1b43b4-e071-4f18-b141-6fd95dfe6df8", "content-length": "2", "date": "Thu, 30 Jan 2025 20:26:30 GMT"} })
103232025-01-30T20:26:31.433ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103242025-01-30T20:26:31.433ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bc3ea4e-4cc4-41cb-b5c1-e53d521ebe98", "content-length": "52", "date": "Thu, 30 Jan 2025 20:26:30 GMT"} })
103252025-01-30T20:26:31.433ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
103262025-01-30T20:26:31.433ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103272025-01-30T20:26:31.568ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fd148333-e293-40c9-bc85-1d504596aa0d", "date": "Thu, 30 Jan 2025 20:26:31 GMT"} })
103282025-01-30T20:26:31.568ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
103292025-01-30T20:26:31.568ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103302025-01-30T20:26:31.569ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3c408d5-135a-497d-9924-27dbe6048e5d", "content-length": "682", "date": "Thu, 30 Jan 2025 20:26:31 GMT"} })
103312025-01-30T20:26:31.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103322025-01-30T20:26:31.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103332025-01-30T20:26:31.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103342025-01-30T20:26:31.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103352025-01-30T20:26:31.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103362025-01-30T20:26:31.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103372025-01-30T20:26:31.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103382025-01-30T20:26:31.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103392025-01-30T20:26:31.588ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 787.331392ms iteration = 19 status = {}
103402025-01-30T20:26:31.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a63ea0f3-42eb-455a-973a-32b0e94ac8bf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
103412025-01-30T20:26:31.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a63ea0f3-42eb-455a-973a-32b0e94ac8bf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
103422025-01-30T20:26:31.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = a63ea0f3-42eb-455a-973a-32b0e94ac8bf response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
103432025-01-30T20:26:31.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5f48d309-eb2c-4a47-abe8-e2d15d43cfe3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103442025-01-30T20:26:31.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5f48d309-eb2c-4a47-abe8-e2d15d43cfe3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103452025-01-30T20:26:31.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5f48d309-eb2c-4a47-abe8-e2d15d43cfe3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103462025-01-30T20:26:32.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = c4d2dc59-7557-4bba-83eb-9a5bafe1f4a0 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
103472025-01-30T20:26:32.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = c4d2dc59-7557-4bba-83eb-9a5bafe1f4a0 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
103482025-01-30T20:26:32.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = c4d2dc59-7557-4bba-83eb-9a5bafe1f4a0 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
103492025-01-30T20:26:32.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 3e2e730a-d4fc-45d8-a62d-905142505971 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
103502025-01-30T20:26:32.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 3e2e730a-d4fc-45d8-a62d-905142505971 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
103512025-01-30T20:26:32.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 3e2e730a-d4fc-45d8-a62d-905142505971 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
103522025-01-30T20:26:32.446ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 435 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 2671a752-e2c8-47d8-a24f-920c18b2b2a5 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
103532025-01-30T20:26:32.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f803251f-fb2b-4c62-8288-abda55d7af0b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103542025-01-30T20:26:32.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f803251f-fb2b-4c62-8288-abda55d7af0b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103552025-01-30T20:26:32.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f803251f-fb2b-4c62-8288-abda55d7af0b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103562025-01-30T20:26:33.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 14c2d7de-dd6e-4c10-9568-323232a26399 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103572025-01-30T20:26:33.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 14c2d7de-dd6e-4c10-9568-323232a26399 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103582025-01-30T20:26:33.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2501 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 14c2d7de-dd6e-4c10-9568-323232a26399 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103592025-01-30T20:26:34.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 11da5312-c086-4c51-9f3f-9f23694d88da roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103602025-01-30T20:26:34.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 11da5312-c086-4c51-9f3f-9f23694d88da resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103612025-01-30T20:26:34.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 11da5312-c086-4c51-9f3f-9f23694d88da response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103622025-01-30T20:26:36.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f1dfcec4-90e0-4720-92fe-8d61f46bf0e9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103632025-01-30T20:26:36.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f1dfcec4-90e0-4720-92fe-8d61f46bf0e9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103642025-01-30T20:26:36.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f1dfcec4-90e0-4720-92fe-8d61f46bf0e9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103652025-01-30T20:26:37.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8084d69f-4a3c-431e-a7f1-47aed0ae0634 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103662025-01-30T20:26:37.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8084d69f-4a3c-431e-a7f1-47aed0ae0634 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103672025-01-30T20:26:37.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8084d69f-4a3c-431e-a7f1-47aed0ae0634 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103682025-01-30T20:26:38.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 00f6f77c-9054-4edc-be88-11add851f632 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103692025-01-30T20:26:38.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 00f6f77c-9054-4edc-be88-11add851f632 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103702025-01-30T20:26:38.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 00f6f77c-9054-4edc-be88-11add851f632 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103712025-01-30T20:26:39.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 858eb1c6-9046-4be9-b46f-139a942a10c8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103722025-01-30T20:26:39.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 858eb1c6-9046-4be9-b46f-139a942a10c8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103732025-01-30T20:26:39.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 858eb1c6-9046-4be9-b46f-139a942a10c8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103742025-01-30T20:26:40.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 44c991c4-a958-4b62-a609-af928937ba3f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103752025-01-30T20:26:40.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 44c991c4-a958-4b62-a609-af928937ba3f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103762025-01-30T20:26:40.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 44c991c4-a958-4b62-a609-af928937ba3f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103772025-01-30T20:26:40.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
103782025-01-30T20:26:40.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
103792025-01-30T20:26:40.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103802025-01-30T20:26:40.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103812025-01-30T20:26:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103822025-01-30T20:26:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103832025-01-30T20:26:40.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103842025-01-30T20:26:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103852025-01-30T20:26:40.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103862025-01-30T20:26:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103872025-01-30T20:26:40.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103882025-01-30T20:26:40.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103892025-01-30T20:26:40.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103902025-01-30T20:26:40.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103912025-01-30T20:26:40.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103922025-01-30T20:26:40.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
103932025-01-30T20:26:40.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103942025-01-30T20:26:40.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103952025-01-30T20:26:40.852ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
103962025-01-30T20:26:40.852ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.546551ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
103972025-01-30T20:26:40.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.221749ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103982025-01-30T20:26:41.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 81e54dc8-12c6-4436-b1dc-dd19307ffef6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
103992025-01-30T20:26:41.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 81e54dc8-12c6-4436-b1dc-dd19307ffef6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104002025-01-30T20:26:41.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 81e54dc8-12c6-4436-b1dc-dd19307ffef6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104012025-01-30T20:26:42.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 94a3018c-f2db-4c1e-aee8-353f31b698f2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104022025-01-30T20:26:42.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 94a3018c-f2db-4c1e-aee8-353f31b698f2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104032025-01-30T20:26:42.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 94a3018c-f2db-4c1e-aee8-353f31b698f2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104042025-01-30T20:26:42.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 565 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = c0114938-cecc-45c2-b4b9-26b12b5208d1 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
104052025-01-30T20:26:43.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 04082e48-0f42-4a08-9c2a-e6ca0622545e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104062025-01-30T20:26:43.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 04082e48-0f42-4a08-9c2a-e6ca0622545e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104072025-01-30T20:26:43.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 04082e48-0f42-4a08-9c2a-e6ca0622545e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104082025-01-30T20:26:44.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1fbc0155-5f67-4af1-91c3-bad6910c61a4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104092025-01-30T20:26:44.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1fbc0155-5f67-4af1-91c3-bad6910c61a4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104102025-01-30T20:26:44.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1fbc0155-5f67-4af1-91c3-bad6910c61a4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104112025-01-30T20:26:45.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c8625b06-7203-4baf-a6ed-550f671415a0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104122025-01-30T20:26:45.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c8625b06-7203-4baf-a6ed-550f671415a0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104132025-01-30T20:26:45.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c8625b06-7203-4baf-a6ed-550f671415a0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104142025-01-30T20:26:46.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f0718dbf-dfe7-4c4e-967d-e9c929f8a947 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104152025-01-30T20:26:46.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f0718dbf-dfe7-4c4e-967d-e9c929f8a947 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104162025-01-30T20:26:46.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f0718dbf-dfe7-4c4e-967d-e9c929f8a947 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104172025-01-30T20:26:47.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4efeaff7-3004-45c8-8145-5a4b43e063ca roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104182025-01-30T20:26:47.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4efeaff7-3004-45c8-8145-5a4b43e063ca resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104192025-01-30T20:26:47.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4efeaff7-3004-45c8-8145-5a4b43e063ca response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104202025-01-30T20:26:48.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 10a9df55-b83f-49f2-a1ed-2dcd2f4f5f14 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104212025-01-30T20:26:48.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 10a9df55-b83f-49f2-a1ed-2dcd2f4f5f14 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104222025-01-30T20:26:48.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 10a9df55-b83f-49f2-a1ed-2dcd2f4f5f14 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104232025-01-30T20:26:49.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f174c33e-bdf4-4817-9957-de6698bd9191 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104242025-01-30T20:26:49.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f174c33e-bdf4-4817-9957-de6698bd9191 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104252025-01-30T20:26:49.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f174c33e-bdf4-4817-9957-de6698bd9191 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104262025-01-30T20:26:50.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d8b54f1b-0c0d-4fe2-bcfb-1e1ea46df90d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104272025-01-30T20:26:50.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d8b54f1b-0c0d-4fe2-bcfb-1e1ea46df90d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104282025-01-30T20:26:50.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d8b54f1b-0c0d-4fe2-bcfb-1e1ea46df90d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104292025-01-30T20:26:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
104302025-01-30T20:26:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104312025-01-30T20:26:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
104322025-01-30T20:26:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104332025-01-30T20:26:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104342025-01-30T20:26:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104352025-01-30T20:26:50.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104362025-01-30T20:26:50.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104372025-01-30T20:26:50.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.618599ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104382025-01-30T20:26:50.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104392025-01-30T20:26:50.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104402025-01-30T20:26:50.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104412025-01-30T20:26:50.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104422025-01-30T20:26:50.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104432025-01-30T20:26:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104442025-01-30T20:26:50.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104452025-01-30T20:26:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
104462025-01-30T20:26:50.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104472025-01-30T20:26:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104482025-01-30T20:26:50.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
104492025-01-30T20:26:50.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.252622ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
104502025-01-30T20:26:51.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8052168a-13ac-43c2-9595-925de1479c20 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104512025-01-30T20:26:51.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8052168a-13ac-43c2-9595-925de1479c20 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104522025-01-30T20:26:51.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8052168a-13ac-43c2-9595-925de1479c20 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104532025-01-30T20:26:52.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 39576b9c-5fd0-4341-b1e9-60420f16fd47 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104542025-01-30T20:26:52.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 39576b9c-5fd0-4341-b1e9-60420f16fd47 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104552025-01-30T20:26:52.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 39576b9c-5fd0-4341-b1e9-60420f16fd47 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104562025-01-30T20:26:52.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 489 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 0ead467a-1bf3-4d0d-841b-da9c1aa9731e response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
104572025-01-30T20:26:53.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a62fbfc-230d-428b-bb97-6ef380abe1e8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104582025-01-30T20:26:53.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a62fbfc-230d-428b-bb97-6ef380abe1e8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104592025-01-30T20:26:53.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a62fbfc-230d-428b-bb97-6ef380abe1e8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104602025-01-30T20:26:54.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e64bbfee-8a4e-410d-a2aa-6d6ade3ba5de roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104612025-01-30T20:26:54.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e64bbfee-8a4e-410d-a2aa-6d6ade3ba5de resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104622025-01-30T20:26:54.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e64bbfee-8a4e-410d-a2aa-6d6ade3ba5de response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104632025-01-30T20:26:55.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd5fbc4c-29cf-49bd-b0e2-a8faa0b90ea8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104642025-01-30T20:26:55.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd5fbc4c-29cf-49bd-b0e2-a8faa0b90ea8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104652025-01-30T20:26:55.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fd5fbc4c-29cf-49bd-b0e2-a8faa0b90ea8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104662025-01-30T20:26:56.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f1491099-818d-4f9d-b827-71abc07291f0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104672025-01-30T20:26:56.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f1491099-818d-4f9d-b827-71abc07291f0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104682025-01-30T20:26:56.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f1491099-818d-4f9d-b827-71abc07291f0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104692025-01-30T20:26:57.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 201d43f2-9b15-45f6-b7d7-9fc7ea38d4e3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104702025-01-30T20:26:57.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 201d43f2-9b15-45f6-b7d7-9fc7ea38d4e3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104712025-01-30T20:26:57.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 201d43f2-9b15-45f6-b7d7-9fc7ea38d4e3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104722025-01-30T20:26:58.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0ff21967-43c6-4455-85a9-f1137b51f12b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104732025-01-30T20:26:58.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0ff21967-43c6-4455-85a9-f1137b51f12b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104742025-01-30T20:26:58.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0ff21967-43c6-4455-85a9-f1137b51f12b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104752025-01-30T20:26:59.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cb99aeb7-0672-483f-84f6-ff7ad54e7cfe roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104762025-01-30T20:26:59.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cb99aeb7-0672-483f-84f6-ff7ad54e7cfe resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104772025-01-30T20:26:59.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cb99aeb7-0672-483f-84f6-ff7ad54e7cfe response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104782025-01-30T20:27:00.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 12f40565-7b15-4413-bf39-f9f9638eec71 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104792025-01-30T20:27:00.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 12f40565-7b15-4413-bf39-f9f9638eec71 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104802025-01-30T20:27:00.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 12f40565-7b15-4413-bf39-f9f9638eec71 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
104812025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
104822025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104832025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
104842025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104852025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
104862025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104872025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
104882025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
104892025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
104902025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104912025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
104922025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
104932025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
104942025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104952025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
104962025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
104972025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104982025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
104992025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105002025-01-30T20:27:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
105012025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105022025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
105032025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105042025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
105052025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105062025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105072025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
105082025-01-30T20:27:00.802ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105092025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105102025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
105112025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105122025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
105132025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105142025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
105152025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
105162025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
105172025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105182025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105192025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105202025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105212025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105222025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105232025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105242025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105252025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105262025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105272025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105282025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105292025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105302025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105312025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105322025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105332025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
105342025-01-30T20:27:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105352025-01-30T20:27:00.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105362025-01-30T20:27:00.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105372025-01-30T20:27:00.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.706523ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105382025-01-30T20:27:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105392025-01-30T20:27:00.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105402025-01-30T20:27:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105412025-01-30T20:27:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
105422025-01-30T20:27:00.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105432025-01-30T20:27:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105442025-01-30T20:27:00.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2772, tv_nsec: 20248439 } })
105452025-01-30T20:27:00.810ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
105462025-01-30T20:27:00.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2772, tv_nsec: 22480291 } })
105472025-01-30T20:27:00.813ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105482025-01-30T20:27:00.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
105492025-01-30T20:27:00.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105502025-01-30T20:27:00.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105512025-01-30T20:27:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105522025-01-30T20:27:00.816ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2772, tv_nsec: 26165044 } })
105532025-01-30T20:27:00.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
105542025-01-30T20:27:00.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105552025-01-30T20:27:00.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105562025-01-30T20:27:00.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105572025-01-30T20:27:00.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105582025-01-30T20:27:00.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.271165ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
105592025-01-30T20:27:00.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105602025-01-30T20:27:00.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.622612ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
105612025-01-30T20:27:00.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105622025-01-30T20:27:00.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105632025-01-30T20:27:00.852ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105642025-01-30T20:27:00.852ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
105652025-01-30T20:27:00.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105662025-01-30T20:27:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105672025-01-30T20:27:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
105682025-01-30T20:27:00.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105692025-01-30T20:27:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105702025-01-30T20:27:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105712025-01-30T20:27:00.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105722025-01-30T20:27:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105732025-01-30T20:27:00.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
105742025-01-30T20:27:00.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105752025-01-30T20:27:00.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105762025-01-30T20:27:00.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105772025-01-30T20:27:00.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105782025-01-30T20:27:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105792025-01-30T20:27:00.856ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105802025-01-30T20:27:00.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105812025-01-30T20:27:00.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105822025-01-30T20:27:00.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.669797ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105832025-01-30T20:27:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105842025-01-30T20:27:00.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105852025-01-30T20:27:00.857ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105862025-01-30T20:27:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105872025-01-30T20:27:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105882025-01-30T20:27:00.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
105892025-01-30T20:27:00.858ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
105902025-01-30T20:27:00.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
105912025-01-30T20:27:00.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105922025-01-30T20:27:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105932025-01-30T20:27:00.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105942025-01-30T20:27:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105952025-01-30T20:27:00.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105962025-01-30T20:27:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
105972025-01-30T20:27:00.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105982025-01-30T20:27:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105992025-01-30T20:27:00.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106002025-01-30T20:27:00.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106012025-01-30T20:27:00.884ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106022025-01-30T20:27:00.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106032025-01-30T20:27:00.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106042025-01-30T20:27:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106052025-01-30T20:27:00.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.632877ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106062025-01-30T20:27:00.887ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
106072025-01-30T20:27:00.887ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.807451ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
106082025-01-30T20:27:00.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106092025-01-30T20:27:00.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
106102025-01-30T20:27:00.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106112025-01-30T20:27:00.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106122025-01-30T20:27:00.891ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.946486ms iteration = 20 status = 0
106132025-01-30T20:27:00.894ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106142025-01-30T20:27:00.894ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106152025-01-30T20:27:00.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106162025-01-30T20:27:00.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106172025-01-30T20:27:00.897ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
106182025-01-30T20:27:00.897ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106192025-01-30T20:27:00.898ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6546125e-08b8-4c5f-8bcb-41d87cda2c15", "content-length": "26", "date": "Thu, 30 Jan 2025 20:27:00 GMT"} })
106202025-01-30T20:27:00.898ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106212025-01-30T20:27:00.898ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
106222025-01-30T20:27:00.898ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106232025-01-30T20:27:00.899ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "70666260-4645-4e94-953d-98f06c40c157", "content-length": "26", "date": "Thu, 30 Jan 2025 20:27:00 GMT"} })
106242025-01-30T20:27:00.899ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106252025-01-30T20:27:00.899ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106262025-01-30T20:27:00.900ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
106272025-01-30T20:27:00.900ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106282025-01-30T20:27:00.900ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
106292025-01-30T20:27:00.900ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c0b8989-0867-4d11-96a5-930eb8356b31", "content-length": "26", "date": "Thu, 30 Jan 2025 20:27:00 GMT"} })
106302025-01-30T20:27:00.900ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106312025-01-30T20:27:00.901ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
106322025-01-30T20:27:00.901ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 99.911653ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
106332025-01-30T20:27:00.902ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106342025-01-30T20:27:00.902ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
106352025-01-30T20:27:00.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106362025-01-30T20:27:00.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
106372025-01-30T20:27:00.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106382025-01-30T20:27:00.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106392025-01-30T20:27:00.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106402025-01-30T20:27:00.904ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106412025-01-30T20:27:00.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.899075ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106422025-01-30T20:27:00.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
106432025-01-30T20:27:00.910ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
106442025-01-30T20:27:00.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
106452025-01-30T20:27:00.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.54772ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
106462025-01-30T20:27:00.936ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106472025-01-30T20:27:00.936ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
106482025-01-30T20:27:00.936ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 134.624276ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
106492025-01-30T20:27:00.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106502025-01-30T20:27:00.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106512025-01-30T20:27:00.943ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
106522025-01-30T20:27:00.943ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 141.339493ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
106532025-01-30T20:27:00.986ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 184.360667ms iteration = 22 status = {"physical_disks_added":0}
106542025-01-30T20:27:01.022ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
106552025-01-30T20:27:01.022ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106562025-01-30T20:27:01.023ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d802cb25-4613-4186-a573-4f018d7ea2b8", "content-length": "372", "date": "Thu, 30 Jan 2025 20:27:01 GMT"} })
106572025-01-30T20:27:01.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106582025-01-30T20:27:01.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106592025-01-30T20:27:01.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106602025-01-30T20:27:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106612025-01-30T20:27:01.038ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
106622025-01-30T20:27:01.038ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
106632025-01-30T20:27:01.039ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "17c66c2f-76bf-4fb2-86f7-5894e0718c8e", "date": "Thu, 30 Jan 2025 20:27:01 GMT"} })
106642025-01-30T20:27:01.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106652025-01-30T20:27:01.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106662025-01-30T20:27:01.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106672025-01-30T20:27:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106682025-01-30T20:27:01.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106692025-01-30T20:27:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106702025-01-30T20:27:01.048ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
106712025-01-30T20:27:01.048ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106722025-01-30T20:27:01.048ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "18c5d50c-806b-4197-bd91-d37528d90833", "date": "Thu, 30 Jan 2025 20:27:01 GMT"} })
106732025-01-30T20:27:01.050ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 248.259081ms iteration = 20 status = {}
106742025-01-30T20:27:01.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106752025-01-30T20:27:01.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106762025-01-30T20:27:01.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106772025-01-30T20:27:01.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106782025-01-30T20:27:01.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106792025-01-30T20:27:01.067ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106802025-01-30T20:27:01.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106812025-01-30T20:27:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106822025-01-30T20:27:01.115ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
106832025-01-30T20:27:01.115ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6fd6354-493f-49a3-87a0-f264e8202f18", "content-length": "1", "date": "Thu, 30 Jan 2025 20:27:00 GMT"} })
106842025-01-30T20:27:01.116ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106852025-01-30T20:27:01.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106862025-01-30T20:27:01.121ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 319.254841ms iteration = 20 status = null
106872025-01-30T20:27:01.129ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 327.412827ms iteration = 20 status = {}
106882025-01-30T20:27:01.159ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
106892025-01-30T20:27:01.159ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4873f748-d417-4903-b0a0-dca9235d47c0", "content-length": "691", "date": "Thu, 30 Jan 2025 20:27:01 GMT"} })
106902025-01-30T20:27:01.159ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
106912025-01-30T20:27:01.159ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
106922025-01-30T20:27:01.159ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
106932025-01-30T20:27:01.161ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 359.658631ms iteration = 20 status = {}
106942025-01-30T20:27:01.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106952025-01-30T20:27:01.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106962025-01-30T20:27:01.183ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
106972025-01-30T20:27:01.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106982025-01-30T20:27:01.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106992025-01-30T20:27:01.193ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
107002025-01-30T20:27:01.193ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "77f9aa24-998f-4684-a2c3-68c669ffbe73", "content-length": "134", "date": "Thu, 30 Jan 2025 20:27:00 GMT"} })
107012025-01-30T20:27:01.193ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
107022025-01-30T20:27:01.193ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
107032025-01-30T20:27:01.194ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
107042025-01-30T20:27:01.194ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
107052025-01-30T20:27:01.194ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107062025-01-30T20:27:01.194ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107072025-01-30T20:27:01.194ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107082025-01-30T20:27:01.194ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107092025-01-30T20:27:01.194ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107102025-01-30T20:27:01.194ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107112025-01-30T20:27:01.195ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
107122025-01-30T20:27:01.195ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107132025-01-30T20:27:01.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107142025-01-30T20:27:01.198ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
107152025-01-30T20:27:01.198ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "536c881d-fff5-4442-8e1b-2f55d483f990", "content-length": "2", "date": "Thu, 30 Jan 2025 20:27:00 GMT"} })
107162025-01-30T20:27:01.198ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
107172025-01-30T20:27:01.198ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b10cd9d-0f02-4b26-996b-cdcdd14fb438", "content-length": "52", "date": "Thu, 30 Jan 2025 20:27:00 GMT"} })
107182025-01-30T20:27:01.198ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
107192025-01-30T20:27:01.198ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
107202025-01-30T20:27:01.332ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7c099689-fc0f-4339-8197-dca10342420f", "date": "Thu, 30 Jan 2025 20:27:01 GMT"} })
107212025-01-30T20:27:01.332ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
107222025-01-30T20:27:01.332ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
107232025-01-30T20:27:01.332ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f6f415d-e249-4f68-9d96-e907e9e51fbe", "content-length": "682", "date": "Thu, 30 Jan 2025 20:27:01 GMT"} })
107242025-01-30T20:27:01.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107252025-01-30T20:27:01.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107262025-01-30T20:27:01.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107272025-01-30T20:27:01.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107282025-01-30T20:27:01.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107292025-01-30T20:27:01.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107302025-01-30T20:27:01.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107312025-01-30T20:27:01.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107322025-01-30T20:27:01.350ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 548.864993ms iteration = 20 status = {}
107332025-01-30T20:27:01.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3f240564-b2cb-4c22-9051-f5731453b081 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107342025-01-30T20:27:01.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3f240564-b2cb-4c22-9051-f5731453b081 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107352025-01-30T20:27:01.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3f240564-b2cb-4c22-9051-f5731453b081 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107362025-01-30T20:27:01.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 0e296bb8-56d6-4061-a0d6-33399a60c407 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
107372025-01-30T20:27:01.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 0e296bb8-56d6-4061-a0d6-33399a60c407 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
107382025-01-30T20:27:01.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 0e296bb8-56d6-4061-a0d6-33399a60c407 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
107392025-01-30T20:27:02.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 497 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 317f16bd-037c-4906-b3b6-c4c64cede4b8 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
107402025-01-30T20:27:02.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 289c8afd-1f4a-476f-8fbe-665dabee8918 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107412025-01-30T20:27:02.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 289c8afd-1f4a-476f-8fbe-665dabee8918 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107422025-01-30T20:27:02.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 289c8afd-1f4a-476f-8fbe-665dabee8918 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107432025-01-30T20:27:03.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = de44c6aa-3795-4f46-92b9-cb1f8fc1ab1f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107442025-01-30T20:27:03.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = de44c6aa-3795-4f46-92b9-cb1f8fc1ab1f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107452025-01-30T20:27:03.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = de44c6aa-3795-4f46-92b9-cb1f8fc1ab1f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107462025-01-30T20:27:04.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0660c6a0-86a5-43c1-add6-b8943a136a71 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107472025-01-30T20:27:04.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0660c6a0-86a5-43c1-add6-b8943a136a71 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107482025-01-30T20:27:04.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0660c6a0-86a5-43c1-add6-b8943a136a71 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107492025-01-30T20:27:05.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7864583a-b64e-4316-a93a-28270883d9e8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107502025-01-30T20:27:05.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7864583a-b64e-4316-a93a-28270883d9e8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107512025-01-30T20:27:05.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7864583a-b64e-4316-a93a-28270883d9e8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107522025-01-30T20:27:06.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1086eca8-f3f8-417e-b374-39c9ad6d18b5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107532025-01-30T20:27:06.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1086eca8-f3f8-417e-b374-39c9ad6d18b5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107542025-01-30T20:27:06.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1086eca8-f3f8-417e-b374-39c9ad6d18b5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107552025-01-30T20:27:07.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 722322e5-4e91-4441-b2ce-5c3933867b59 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107562025-01-30T20:27:07.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 722322e5-4e91-4441-b2ce-5c3933867b59 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107572025-01-30T20:27:07.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 722322e5-4e91-4441-b2ce-5c3933867b59 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107582025-01-30T20:27:08.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7742cc08-f62b-42f7-9935-5f2bdb5139b7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107592025-01-30T20:27:08.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7742cc08-f62b-42f7-9935-5f2bdb5139b7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107602025-01-30T20:27:08.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7742cc08-f62b-42f7-9935-5f2bdb5139b7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107612025-01-30T20:27:09.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 048b6f77-5739-4d27-8caa-e02d9829fe4a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107622025-01-30T20:27:09.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 048b6f77-5739-4d27-8caa-e02d9829fe4a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107632025-01-30T20:27:09.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 048b6f77-5739-4d27-8caa-e02d9829fe4a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107642025-01-30T20:27:10.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
107652025-01-30T20:27:10.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
107662025-01-30T20:27:10.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107672025-01-30T20:27:10.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107682025-01-30T20:27:10.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107692025-01-30T20:27:10.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107702025-01-30T20:27:10.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107712025-01-30T20:27:10.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107722025-01-30T20:27:10.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107732025-01-30T20:27:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107742025-01-30T20:27:10.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107752025-01-30T20:27:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107762025-01-30T20:27:10.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107772025-01-30T20:27:10.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107782025-01-30T20:27:10.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.46343ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107792025-01-30T20:27:10.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107802025-01-30T20:27:10.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
107812025-01-30T20:27:10.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107822025-01-30T20:27:10.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107832025-01-30T20:27:10.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 47a3f7a9-aa8b-421e-94de-eef4ae300517 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107842025-01-30T20:27:10.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 47a3f7a9-aa8b-421e-94de-eef4ae300517 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107852025-01-30T20:27:10.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 47a3f7a9-aa8b-421e-94de-eef4ae300517 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107862025-01-30T20:27:10.849ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
107872025-01-30T20:27:10.849ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.628442ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
107882025-01-30T20:27:11.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 56b35c5c-a159-4daf-8cbc-f281b5df93a5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107892025-01-30T20:27:11.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 56b35c5c-a159-4daf-8cbc-f281b5df93a5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107902025-01-30T20:27:11.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 56b35c5c-a159-4daf-8cbc-f281b5df93a5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107912025-01-30T20:27:12.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 595 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 215f2de3-0e82-4c0e-b033-ae98c6b3049e response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
107922025-01-30T20:27:12.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8402685d-01c6-4444-b2a0-067e1e39b4d1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107932025-01-30T20:27:12.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8402685d-01c6-4444-b2a0-067e1e39b4d1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107942025-01-30T20:27:12.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8402685d-01c6-4444-b2a0-067e1e39b4d1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107952025-01-30T20:27:13.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 975ddbbb-134f-4c28-976b-87d3dfe4c6ef roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107962025-01-30T20:27:13.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 975ddbbb-134f-4c28-976b-87d3dfe4c6ef resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107972025-01-30T20:27:13.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 975ddbbb-134f-4c28-976b-87d3dfe4c6ef response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107982025-01-30T20:27:14.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e7a5ca92-f5d7-45cb-a37f-e5f60fd58690 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
107992025-01-30T20:27:14.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e7a5ca92-f5d7-45cb-a37f-e5f60fd58690 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108002025-01-30T20:27:14.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e7a5ca92-f5d7-45cb-a37f-e5f60fd58690 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108012025-01-30T20:27:15.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5b0e7432-2ca3-4edb-9d61-c9bae0da166b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108022025-01-30T20:27:15.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5b0e7432-2ca3-4edb-9d61-c9bae0da166b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108032025-01-30T20:27:15.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5b0e7432-2ca3-4edb-9d61-c9bae0da166b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108042025-01-30T20:27:16.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 447d85bf-320a-437a-b650-2b98d3ea3ea6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108052025-01-30T20:27:16.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 447d85bf-320a-437a-b650-2b98d3ea3ea6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108062025-01-30T20:27:16.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 447d85bf-320a-437a-b650-2b98d3ea3ea6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108072025-01-30T20:27:17.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 5a263065-8429-45e2-944c-e3df0bf9109d roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
108082025-01-30T20:27:17.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 5a263065-8429-45e2-944c-e3df0bf9109d resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
108092025-01-30T20:27:17.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 5a263065-8429-45e2-944c-e3df0bf9109d response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
108102025-01-30T20:27:17.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 10a2f14f-e6e0-4beb-b817-ffaf17bbc6f2 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
108112025-01-30T20:27:17.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 10a2f14f-e6e0-4beb-b817-ffaf17bbc6f2 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
108122025-01-30T20:27:17.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = 10a2f14f-e6e0-4beb-b817-ffaf17bbc6f2 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
108132025-01-30T20:27:17.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ad4cdea6-1bb0-4698-aef8-8c40c95cb7aa roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108142025-01-30T20:27:17.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ad4cdea6-1bb0-4698-aef8-8c40c95cb7aa resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108152025-01-30T20:27:18.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ad4cdea6-1bb0-4698-aef8-8c40c95cb7aa response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108162025-01-30T20:27:19.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5621f519-2d74-4bf3-97c2-794a4a9e37e6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108172025-01-30T20:27:19.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5621f519-2d74-4bf3-97c2-794a4a9e37e6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108182025-01-30T20:27:19.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5621f519-2d74-4bf3-97c2-794a4a9e37e6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108192025-01-30T20:27:20.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8c4c1bb6-9af8-44a7-a3cc-db7364526ae0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108202025-01-30T20:27:20.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8c4c1bb6-9af8-44a7-a3cc-db7364526ae0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108212025-01-30T20:27:20.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8c4c1bb6-9af8-44a7-a3cc-db7364526ae0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108222025-01-30T20:27:20.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
108232025-01-30T20:27:20.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
108242025-01-30T20:27:20.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108252025-01-30T20:27:20.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108262025-01-30T20:27:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108272025-01-30T20:27:20.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108282025-01-30T20:27:20.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108292025-01-30T20:27:20.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108302025-01-30T20:27:20.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108312025-01-30T20:27:20.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.767824ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108322025-01-30T20:27:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108332025-01-30T20:27:20.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108342025-01-30T20:27:20.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108352025-01-30T20:27:20.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108362025-01-30T20:27:20.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108372025-01-30T20:27:20.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108382025-01-30T20:27:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
108392025-01-30T20:27:20.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108402025-01-30T20:27:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108412025-01-30T20:27:20.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
108422025-01-30T20:27:20.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.956858ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
108432025-01-30T20:27:21.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7db81ca9-5aca-46c9-ae9a-2ed4902ed622 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108442025-01-30T20:27:21.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7db81ca9-5aca-46c9-ae9a-2ed4902ed622 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108452025-01-30T20:27:21.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1825 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7db81ca9-5aca-46c9-ae9a-2ed4902ed622 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108462025-01-30T20:27:22.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4903c1c6-3b06-4981-a39d-4e2ad3645949 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108472025-01-30T20:27:22.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4903c1c6-3b06-4981-a39d-4e2ad3645949 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108482025-01-30T20:27:22.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4903c1c6-3b06-4981-a39d-4e2ad3645949 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108492025-01-30T20:27:22.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 472 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 7e877078-71bd-4cf6-a756-32578a9b51c1 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
108502025-01-30T20:27:23.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3028df01-187d-41c0-9d21-dbe563bcaf69 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108512025-01-30T20:27:23.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3028df01-187d-41c0-9d21-dbe563bcaf69 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108522025-01-30T20:27:23.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3028df01-187d-41c0-9d21-dbe563bcaf69 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108532025-01-30T20:27:24.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 03509d1c-348b-4929-a8e3-8a06bfab5cfd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108542025-01-30T20:27:24.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 03509d1c-348b-4929-a8e3-8a06bfab5cfd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108552025-01-30T20:27:24.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 03509d1c-348b-4929-a8e3-8a06bfab5cfd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108562025-01-30T20:27:25.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 306dda1d-e4fb-4bc8-b6a9-e41bb16242dd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108572025-01-30T20:27:25.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 306dda1d-e4fb-4bc8-b6a9-e41bb16242dd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108582025-01-30T20:27:25.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 306dda1d-e4fb-4bc8-b6a9-e41bb16242dd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108592025-01-30T20:27:26.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cac09cc6-2b03-4008-8232-faa8b37ad467 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108602025-01-30T20:27:26.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cac09cc6-2b03-4008-8232-faa8b37ad467 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108612025-01-30T20:27:26.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cac09cc6-2b03-4008-8232-faa8b37ad467 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108622025-01-30T20:27:27.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d9f6afc7-d18b-4c21-a13f-e9146a8eadf5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108632025-01-30T20:27:27.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d9f6afc7-d18b-4c21-a13f-e9146a8eadf5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108642025-01-30T20:27:27.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d9f6afc7-d18b-4c21-a13f-e9146a8eadf5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108652025-01-30T20:27:28.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4e584b89-ca05-4c14-a983-6f46a125fad1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108662025-01-30T20:27:28.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4e584b89-ca05-4c14-a983-6f46a125fad1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108672025-01-30T20:27:28.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4e584b89-ca05-4c14-a983-6f46a125fad1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108682025-01-30T20:27:29.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 033a268a-93d6-4288-898c-dd52c774ec23 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108692025-01-30T20:27:29.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 033a268a-93d6-4288-898c-dd52c774ec23 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108702025-01-30T20:27:29.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 033a268a-93d6-4288-898c-dd52c774ec23 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108712025-01-30T20:27:30.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 33617292-2345-4d45-969a-223973c7d56d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108722025-01-30T20:27:30.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 33617292-2345-4d45-969a-223973c7d56d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108732025-01-30T20:27:30.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 33617292-2345-4d45-969a-223973c7d56d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
108742025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
108752025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
108762025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
108772025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
108782025-01-30T20:27:30.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
108792025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.65\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
108802025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
108812025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
108822025-01-30T20:27:30.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
108832025-01-30T20:27:30.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:17:30.801271239 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
108842025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
108852025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
108862025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
108872025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108882025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108892025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
108902025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
108912025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
108922025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
108932025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108942025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108952025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
108962025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
108972025-01-30T20:27:30.801ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
108982025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
108992025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
109002025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109012025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
109022025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
109032025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109042025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
109052025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
109062025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109072025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
109082025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
109092025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109102025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
109112025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109122025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
109132025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
109142025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109152025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
109162025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109172025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
109182025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
109192025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
109202025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
109212025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
109222025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109232025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
109242025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
109252025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
109262025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109272025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
109282025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
109292025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
109302025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
109312025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109322025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
109332025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
109342025-01-30T20:27:30.801ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
109352025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109362025-01-30T20:27:30.801ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
109372025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
109382025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
109392025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
109402025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
109412025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
109422025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
109432025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
109442025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
109452025-01-30T20:27:30.801ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
109462025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109472025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109482025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
109492025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
109502025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
109512025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109522025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
109532025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109542025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
109552025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109562025-01-30T20:27:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109572025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
109582025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
109592025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109602025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109612025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109622025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
109632025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109642025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109652025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109662025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
109672025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109682025-01-30T20:27:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2802, tv_nsec: 11691622 } })
109692025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109702025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
109712025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
109722025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
109732025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
109742025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
109752025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109762025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109772025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
109782025-01-30T20:27:30.802ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
109792025-01-30T20:27:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2802, tv_nsec: 11794315 } })
109802025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109812025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
109822025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
109832025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.461771ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
109842025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
109852025-01-30T20:27:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.573984ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
109862025-01-30T20:27:30.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109872025-01-30T20:27:30.804ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.814098ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
109882025-01-30T20:27:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.016121ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
109892025-01-30T20:27:30.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2802, tv_nsec: 14787048 } })
109902025-01-30T20:27:30.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
109912025-01-30T20:27:30.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
109922025-01-30T20:27:30.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109932025-01-30T20:27:30.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109942025-01-30T20:27:30.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109952025-01-30T20:27:30.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109962025-01-30T20:27:30.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109972025-01-30T20:27:30.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109982025-01-30T20:27:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109992025-01-30T20:27:30.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110002025-01-30T20:27:30.808ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:17:30.801271239 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
110012025-01-30T20:27:30.808ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.258581ms iteration = 11 status = {"expiration":"2025-01-30T20:17:30.801271239Z","pruned":[]}
110022025-01-30T20:27:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110032025-01-30T20:27:30.808ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2802, tv_nsec: 18081709 } })
110042025-01-30T20:27:30.808ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
110052025-01-30T20:27:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
110062025-01-30T20:27:30.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110072025-01-30T20:27:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110082025-01-30T20:27:30.810ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110092025-01-30T20:27:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110102025-01-30T20:27:30.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110112025-01-30T20:27:30.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110122025-01-30T20:27:30.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110132025-01-30T20:27:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110142025-01-30T20:27:30.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110152025-01-30T20:27:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110162025-01-30T20:27:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
110172025-01-30T20:27:30.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110182025-01-30T20:27:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110192025-01-30T20:27:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
110202025-01-30T20:27:30.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
110212025-01-30T20:27:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
110222025-01-30T20:27:30.817ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110232025-01-30T20:27:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
110242025-01-30T20:27:30.820ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110252025-01-30T20:27:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110262025-01-30T20:27:30.820ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.798782ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
110272025-01-30T20:27:30.821ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110282025-01-30T20:27:30.821ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110292025-01-30T20:27:30.821ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
110302025-01-30T20:27:30.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110312025-01-30T20:27:30.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110322025-01-30T20:27:30.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110332025-01-30T20:27:30.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110342025-01-30T20:27:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110352025-01-30T20:27:30.824ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110362025-01-30T20:27:30.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110372025-01-30T20:27:30.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110382025-01-30T20:27:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
110392025-01-30T20:27:30.827ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
110402025-01-30T20:27:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
110412025-01-30T20:27:30.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110422025-01-30T20:27:30.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.17167ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110432025-01-30T20:27:30.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2802, tv_nsec: 41151829 } })
110442025-01-30T20:27:30.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
110452025-01-30T20:27:30.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110462025-01-30T20:27:30.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
110472025-01-30T20:27:30.833ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110482025-01-30T20:27:30.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110492025-01-30T20:27:30.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
110502025-01-30T20:27:30.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110512025-01-30T20:27:30.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
110522025-01-30T20:27:30.835ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110532025-01-30T20:27:30.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110542025-01-30T20:27:30.835ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(56610056-3863-4730-be0d-b4e4e691da8d, 0), (4f39c396-f759-4b5d-99bc-8df6540f7454, 0), (f0cace30-059d-4298-810c-da65e8288256, 0), (49e495b3-cfc0-4279-9b6d-54bd5c9618d6, 0)] collection_id = 56610056-3863-4730-be0d-b4e4e691da8d
110552025-01-30T20:27:30.835ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110562025-01-30T20:27:30.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110572025-01-30T20:27:30.839ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110582025-01-30T20:27:30.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
110592025-01-30T20:27:30.842ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110602025-01-30T20:27:30.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
110612025-01-30T20:27:30.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110622025-01-30T20:27:30.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.04047ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
110632025-01-30T20:27:30.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110642025-01-30T20:27:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110652025-01-30T20:27:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
110662025-01-30T20:27:30.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110672025-01-30T20:27:30.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110682025-01-30T20:27:30.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110692025-01-30T20:27:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110702025-01-30T20:27:30.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110712025-01-30T20:27:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110722025-01-30T20:27:30.858ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110732025-01-30T20:27:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110742025-01-30T20:27:30.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110752025-01-30T20:27:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
110762025-01-30T20:27:30.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110772025-01-30T20:27:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
110782025-01-30T20:27:30.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110792025-01-30T20:27:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110802025-01-30T20:27:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110812025-01-30T20:27:30.861ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110822025-01-30T20:27:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110832025-01-30T20:27:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110842025-01-30T20:27:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110852025-01-30T20:27:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110862025-01-30T20:27:30.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110872025-01-30T20:27:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110882025-01-30T20:27:30.865ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110892025-01-30T20:27:30.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110902025-01-30T20:27:30.867ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
110912025-01-30T20:27:30.867ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 66.31985ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
110922025-01-30T20:27:30.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
110932025-01-30T20:27:30.869ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
110942025-01-30T20:27:30.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
110952025-01-30T20:27:30.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110962025-01-30T20:27:30.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110972025-01-30T20:27:30.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110982025-01-30T20:27:30.873ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110992025-01-30T20:27:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111002025-01-30T20:27:30.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111012025-01-30T20:27:30.878ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111022025-01-30T20:27:30.878ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
111032025-01-30T20:27:30.878ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
111042025-01-30T20:27:30.878ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 76.884724ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
111052025-01-30T20:27:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111062025-01-30T20:27:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111072025-01-30T20:27:30.879ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
111082025-01-30T20:27:30.879ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
111092025-01-30T20:27:30.879ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
111102025-01-30T20:27:30.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111112025-01-30T20:27:30.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111122025-01-30T20:27:30.880ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111132025-01-30T20:27:30.881ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111142025-01-30T20:27:30.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111152025-01-30T20:27:30.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
111162025-01-30T20:27:30.883ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
111172025-01-30T20:27:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
111182025-01-30T20:27:30.888ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111192025-01-30T20:27:30.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111202025-01-30T20:27:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
111212025-01-30T20:27:30.891ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111222025-01-30T20:27:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111232025-01-30T20:27:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
111242025-01-30T20:27:30.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111252025-01-30T20:27:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111262025-01-30T20:27:30.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111272025-01-30T20:27:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111282025-01-30T20:27:30.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111292025-01-30T20:27:30.894ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111302025-01-30T20:27:30.896ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111312025-01-30T20:27:30.896ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
111322025-01-30T20:27:30.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111332025-01-30T20:27:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111342025-01-30T20:27:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111352025-01-30T20:27:30.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111362025-01-30T20:27:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
111372025-01-30T20:27:30.898ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111382025-01-30T20:27:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111392025-01-30T20:27:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111402025-01-30T20:27:30.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
111412025-01-30T20:27:30.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
111422025-01-30T20:27:30.903ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
111432025-01-30T20:27:30.903ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
111442025-01-30T20:27:30.903ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
111452025-01-30T20:27:30.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111462025-01-30T20:27:30.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111472025-01-30T20:27:30.906ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
111482025-01-30T20:27:30.906ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
111492025-01-30T20:27:30.906ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 105.391305ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
111502025-01-30T20:27:30.910ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111512025-01-30T20:27:30.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111522025-01-30T20:27:30.911ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
111532025-01-30T20:27:30.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
111542025-01-30T20:27:30.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 110.670121ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111552025-01-30T20:27:30.914ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
111562025-01-30T20:27:30.914ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.76268ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
111572025-01-30T20:27:30.914ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 56610056-3863-4730-be0d-b4e4e691da8d file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
111582025-01-30T20:27:30.914ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111592025-01-30T20:27:30.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111602025-01-30T20:27:30.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.688535ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111612025-01-30T20:27:30.919ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111622025-01-30T20:27:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111632025-01-30T20:27:30.929ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
111642025-01-30T20:27:30.929ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 127.363065ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
111652025-01-30T20:27:30.941ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111662025-01-30T20:27:30.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111672025-01-30T20:27:30.970ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.995021ms iteration = 23 status = {"physical_disks_added":0}
111682025-01-30T20:27:31.168ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
111692025-01-30T20:27:31.168ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
111702025-01-30T20:27:31.169ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f03c4316-bbaa-4487-b571-3a98258e7637", "content-length": "372", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
111712025-01-30T20:27:31.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111722025-01-30T20:27:31.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111732025-01-30T20:27:31.207ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
111742025-01-30T20:27:31.218ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
111752025-01-30T20:27:31.218ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111762025-01-30T20:27:31.218ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e068863c-93a5-4e9c-8f22-62aa6922e679", "content-length": "26", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
111772025-01-30T20:27:31.218ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111782025-01-30T20:27:31.219ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111792025-01-30T20:27:31.226ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
111802025-01-30T20:27:31.237ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
111812025-01-30T20:27:31.237ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111822025-01-30T20:27:31.238ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "366c382c-9f06-4aad-8474-088b78ce1b7f", "content-length": "26", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
111832025-01-30T20:27:31.238ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111842025-01-30T20:27:31.239ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
111852025-01-30T20:27:31.239ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111862025-01-30T20:27:31.239ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5f37c03-a58a-4aac-a4a5-6e06cdd28853", "content-length": "26", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
111872025-01-30T20:27:31.240ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111882025-01-30T20:27:31.241ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111892025-01-30T20:27:31.243ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
111902025-01-30T20:27:31.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 707c92f2-0286-4ed5-a1ae-23db4344ee56 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
111912025-01-30T20:27:31.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 707c92f2-0286-4ed5-a1ae-23db4344ee56 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
111922025-01-30T20:27:31.337ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
111932025-01-30T20:27:31.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
111942025-01-30T20:27:31.349ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111952025-01-30T20:27:31.349ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111962025-01-30T20:27:31.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111972025-01-30T20:27:31.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111982025-01-30T20:27:31.352ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
111992025-01-30T20:27:31.352ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
112002025-01-30T20:27:31.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112012025-01-30T20:27:31.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112022025-01-30T20:27:31.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 707c92f2-0286-4ed5-a1ae-23db4344ee56 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
112032025-01-30T20:27:31.373ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(4f39c396-f759-4b5d-99bc-8df6540f7454, 0), (f0cace30-059d-4298-810c-da65e8288256, 0), (49e495b3-cfc0-4279-9b6d-54bd5c9618d6, 0)]
112042025-01-30T20:27:31.374ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2802, tv_nsec: 583642266 } })
112052025-01-30T20:27:31.382ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
112062025-01-30T20:27:31.382ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 581.427228ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
112072025-01-30T20:27:31.413ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 611.879482ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
112082025-01-30T20:27:31.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112092025-01-30T20:27:31.425ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112102025-01-30T20:27:31.426ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
112112025-01-30T20:27:31.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
112122025-01-30T20:27:31.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
112132025-01-30T20:27:31.428ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
112142025-01-30T20:27:31.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
112152025-01-30T20:27:31.428ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "733d99d8-b383-441f-b084-3868a512f849", "content-length": "1", "date": "Thu, 30 Jan 2025 20:27:30 GMT"} })
112162025-01-30T20:27:31.428ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112172025-01-30T20:27:31.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112182025-01-30T20:27:31.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112192025-01-30T20:27:31.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112202025-01-30T20:27:31.429ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112212025-01-30T20:27:31.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112222025-01-30T20:27:31.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112232025-01-30T20:27:31.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112242025-01-30T20:27:31.433ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112252025-01-30T20:27:31.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
112262025-01-30T20:27:31.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
112272025-01-30T20:27:31.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112282025-01-30T20:27:31.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
112292025-01-30T20:27:31.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
112302025-01-30T20:27:31.434ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
112312025-01-30T20:27:31.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
112322025-01-30T20:27:31.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112332025-01-30T20:27:31.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112342025-01-30T20:27:31.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
112352025-01-30T20:27:31.435ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112362025-01-30T20:27:31.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112372025-01-30T20:27:31.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112382025-01-30T20:27:31.438ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112392025-01-30T20:27:31.438ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
112402025-01-30T20:27:31.438ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 636.853576ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
112412025-01-30T20:27:31.439ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 638.223723ms iteration = 21 status = null
112422025-01-30T20:27:31.439ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112432025-01-30T20:27:31.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
112442025-01-30T20:27:31.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
112452025-01-30T20:27:31.441ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 640.563399ms iteration = 21 status = 0
112462025-01-30T20:27:31.445ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
112472025-01-30T20:27:31.446ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "5725630b-010d-4f4f-ad5d-47c1415993ba", "content-length": "2", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
112482025-01-30T20:27:31.446ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:619 sled = http://[fd00:1122:3344:101::1]:12345
112492025-01-30T20:27:31.446ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 645.375322ms iteration = 21 status = {}
112502025-01-30T20:27:31.448ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 646.499013ms iteration = 3 status = {"last_run_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"operation":"list","target_sled":"80be2cf5-c1f1-42e5-8353-289dd0bb621a","time":"2025-01-30T20:22:31.033583776Z"},{"operation":"list","target_sled":"80be2cf5-c1f1-42e5-8353-289dd0bb621a","time":"2025-01-30T20:27:31.446078435Z"}]}
112512025-01-30T20:27:31.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
112522025-01-30T20:27:31.448ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112532025-01-30T20:27:31.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112542025-01-30T20:27:31.450ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112552025-01-30T20:27:31.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112562025-01-30T20:27:31.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112572025-01-30T20:27:31.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112582025-01-30T20:27:31.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112592025-01-30T20:27:31.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
112602025-01-30T20:27:31.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
112612025-01-30T20:27:31.454ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112622025-01-30T20:27:31.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
112632025-01-30T20:27:31.456ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112642025-01-30T20:27:31.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112652025-01-30T20:27:31.458ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
112662025-01-30T20:27:31.458ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
112672025-01-30T20:27:31.458ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5e9fef64-fffa-4cc2-9b33-af0ea7c594bf", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
112682025-01-30T20:27:31.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112692025-01-30T20:27:31.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112702025-01-30T20:27:31.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112712025-01-30T20:27:31.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112722025-01-30T20:27:31.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112732025-01-30T20:27:31.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112742025-01-30T20:27:31.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112752025-01-30T20:27:31.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112762025-01-30T20:27:31.467ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
112772025-01-30T20:27:31.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
112782025-01-30T20:27:31.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
112792025-01-30T20:27:31.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112802025-01-30T20:27:31.467ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112812025-01-30T20:27:31.467ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
112822025-01-30T20:27:31.467ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
112832025-01-30T20:27:31.467ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-30 20:18:12.536035 UTC dns_group = internal generation = 1
112842025-01-30T20:27:31.467ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 666.551079ms iteration = 11 status = {"generation":1}
112852025-01-30T20:27:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112862025-01-30T20:27:31.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112872025-01-30T20:27:31.469ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
112882025-01-30T20:27:31.469ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 668.050691ms iteration = 5 status = {"blueprint_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","inventory_collection_id":"49e495b3-cfc0-4279-9b6d-54bd5c9618d6","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
112892025-01-30T20:27:31.470ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112902025-01-30T20:27:31.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112912025-01-30T20:27:31.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112922025-01-30T20:27:31.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112932025-01-30T20:27:31.472ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112942025-01-30T20:27:31.475ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
112952025-01-30T20:27:31.475ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112962025-01-30T20:27:31.476ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "512a4d07-ea7b-4511-9ab7-a9165b11267d", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
112972025-01-30T20:27:31.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
112982025-01-30T20:27:31.477ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112992025-01-30T20:27:31.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113002025-01-30T20:27:31.477ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 676.702642ms iteration = 21 status = {}
113012025-01-30T20:27:31.479ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) }
113022025-01-30T20:27:31.479ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 678.218393ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
113032025-01-30T20:27:31.479ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113042025-01-30T20:27:31.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113052025-01-30T20:27:31.481ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113062025-01-30T20:27:31.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113072025-01-30T20:27:31.484ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113082025-01-30T20:27:31.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113092025-01-30T20:27:31.484ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
113102025-01-30T20:27:31.484ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
113112025-01-30T20:27:31.484ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113122025-01-30T20:27:31.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113132025-01-30T20:27:31.486ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
113142025-01-30T20:27:31.486ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113152025-01-30T20:27:31.486ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2bca97d5-fe08-44c4-a2cb-35eca07630d0", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113162025-01-30T20:27:31.486ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113172025-01-30T20:27:31.486ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113182025-01-30T20:27:31.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113192025-01-30T20:27:31.488ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113202025-01-30T20:27:31.488ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b9fa6a45-43a2-4612-b164-fd4d9edbed94", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113212025-01-30T20:27:31.488ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113222025-01-30T20:27:31.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113232025-01-30T20:27:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
113242025-01-30T20:27:31.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113252025-01-30T20:27:31.490ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113262025-01-30T20:27:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113272025-01-30T20:27:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113282025-01-30T20:27:31.490ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113292025-01-30T20:27:31.490ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 689.124886ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
113302025-01-30T20:27:31.491ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
113312025-01-30T20:27:31.491ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
113322025-01-30T20:27:31.491ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-30 20:18:13.133071 UTC dns_group = external generation = 2
113332025-01-30T20:27:31.492ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 690.231527ms iteration = 11 status = {"generation":2}
113342025-01-30T20:27:31.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113352025-01-30T20:27:31.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
113362025-01-30T20:27:31.495ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113372025-01-30T20:27:31.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113382025-01-30T20:27:31.497ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113392025-01-30T20:27:31.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113402025-01-30T20:27:31.498ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113412025-01-30T20:27:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113422025-01-30T20:27:31.500ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113432025-01-30T20:27:31.504ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
113442025-01-30T20:27:31.504ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113452025-01-30T20:27:31.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113462025-01-30T20:27:31.509ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113472025-01-30T20:27:31.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113482025-01-30T20:27:31.511ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113492025-01-30T20:27:31.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113502025-01-30T20:27:31.512ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
113512025-01-30T20:27:31.512ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 710.930562ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
113522025-01-30T20:27:31.513ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113532025-01-30T20:27:31.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113542025-01-30T20:27:31.515ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113552025-01-30T20:27:31.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113562025-01-30T20:27:31.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113572025-01-30T20:27:31.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113582025-01-30T20:27:31.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113592025-01-30T20:27:31.517ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113602025-01-30T20:27:31.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113612025-01-30T20:27:31.519ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113622025-01-30T20:27:31.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113632025-01-30T20:27:31.519ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113642025-01-30T20:27:31.519ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113652025-01-30T20:27:31.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113662025-01-30T20:27:31.520ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113672025-01-30T20:27:31.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113682025-01-30T20:27:31.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113692025-01-30T20:27:31.522ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113702025-01-30T20:27:31.522ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113712025-01-30T20:27:31.522ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113722025-01-30T20:27:31.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113732025-01-30T20:27:31.526ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
113742025-01-30T20:27:31.526ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113752025-01-30T20:27:31.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113762025-01-30T20:27:31.527ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113772025-01-30T20:27:31.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113782025-01-30T20:27:31.529ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113792025-01-30T20:27:31.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113802025-01-30T20:27:31.530ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113812025-01-30T20:27:31.535ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
113822025-01-30T20:27:31.535ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113832025-01-30T20:27:31.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113842025-01-30T20:27:31.642ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
113852025-01-30T20:27:31.643ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae890aad-07c2-4fff-aa78-b3d67de8bd02", "content-length": "691", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
113862025-01-30T20:27:31.643ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
113872025-01-30T20:27:31.643ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
113882025-01-30T20:27:31.643ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
113892025-01-30T20:27:31.644ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 843.592413ms iteration = 21 status = {}
113902025-01-30T20:27:31.645ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
113912025-01-30T20:27:31.645ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113922025-01-30T20:27:31.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113932025-01-30T20:27:31.648ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113942025-01-30T20:27:31.649ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
113952025-01-30T20:27:31.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
113962025-01-30T20:27:31.649ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113972025-01-30T20:27:31.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113982025-01-30T20:27:31.655ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
113992025-01-30T20:27:31.655ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 9426fbef-f962-4a8b-89a5-2e293c5843b5, kind: Service { id: db149fee-69cf-48fe-8393-2d952566bed4 }, name: Name("external-dns-db149fee-69cf-48fe-8393-2d952566bed4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 160])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b31ff1b5-601e-4706-8e7b-3fc9b49f6f5a, kind: Service { id: b855967f-1c83-48e6-a52e-bc2e41c4ec2f }, name: Name("external-dns-b855967f-1c83-48e6-a52e-bc2e41c4ec2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 8439a572-36d3-4b14-be2a-e722ea005c93, kind: Service { id: eab4c9c4-aff5-41de-a773-a76ade40cb0f }, name: Name("nexus-eab4c9c4-aff5-41de-a773-a76ade40cb0f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ccb9988f-737c-4f20-99b2-7101cc72bee1, kind: Service { id: 8d5dfa3d-89df-4ed3-89f6-a30554d47abf }, name: Name("nexus-8d5dfa3d-89df-4ed3-89f6-a30554d47abf"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eec9a6c8-69d4-4e19-9a29-89adacfb230c, kind: Service { id: 75755e9c-437c-480b-8cda-07a28b0dc2a3 }, name: Name("nexus-75755e9c-437c-480b-8cda-07a28b0dc2a3"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 12])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
114002025-01-30T20:27:31.655ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
114012025-01-30T20:27:31.724ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
114022025-01-30T20:27:31.724ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
114032025-01-30T20:27:31.724ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
114042025-01-30T20:27:31.724ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c669c88-91cc-4b54-89ca-39a4509a37f6", "content-length": "476", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114052025-01-30T20:27:31.724ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
114062025-01-30T20:27:31.724ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f07d4f52-d04e-4ed5-96c4-02fc9fe97be0", "content-length": "734", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114072025-01-30T20:27:31.725ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
114082025-01-30T20:27:31.725ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd583dfe-04d5-4955-8205-a05170a61652", "content-length": "111", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114092025-01-30T20:27:31.725ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
114102025-01-30T20:27:31.725ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3cf1700-329f-45b1-a6ea-9d65e24d197c", "content-length": "111", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114112025-01-30T20:27:31.725ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
114122025-01-30T20:27:31.725ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c867a6a-0446-455e-a002-a28bd36cdfad", "content-length": "167", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114132025-01-30T20:27:31.725ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
114142025-01-30T20:27:31.726ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ddeaad4-c068-4997-89b2-776d8a8f86b6", "content-length": "167", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114152025-01-30T20:27:31.726ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
114162025-01-30T20:27:31.726ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff6e833e-e899-4c01-b0c6-ca7dab339252", "content-length": "175", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114172025-01-30T20:27:31.726ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
114182025-01-30T20:27:31.726ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "18ef59a6-20da-4591-be79-39896dde9baf", "content-length": "175", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114192025-01-30T20:27:31.726ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
114202025-01-30T20:27:31.726ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "29c1ba44-4276-47bf-88f1-4ff1f621edd5", "content-length": "702", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114212025-01-30T20:27:31.726ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114222025-01-30T20:27:31.726ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e2e7f39-ef43-43a5-aa46-e1ecb9d09592", "content-length": "727", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114232025-01-30T20:27:31.726ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114242025-01-30T20:27:31.727ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "816eb20f-c0cd-4f34-beaa-b05341bf35a4", "content-length": "729", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114252025-01-30T20:27:31.727ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114262025-01-30T20:27:31.727ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "59b84e55-aa05-47b6-9149-b5fd482256fe", "content-length": "728", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114272025-01-30T20:27:31.727ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
114282025-01-30T20:27:31.727ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "08bb299e-ba10-4cfa-bf7f-c67f982c7501", "content-length": "722", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114292025-01-30T20:27:31.727ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
114302025-01-30T20:27:31.727ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "488566bb-5487-4cc6-b146-a95f3c777a46", "content-length": "109", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114312025-01-30T20:27:31.727ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
114322025-01-30T20:27:31.728ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbb2b51b-3cf8-42a6-aa82-4e71f70d9331", "content-length": "109", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114332025-01-30T20:27:31.728ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
114342025-01-30T20:27:31.728ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bea64b30-c1dc-4d31-a57a-838c8a092d85", "content-length": "169", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114352025-01-30T20:27:31.728ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
114362025-01-30T20:27:31.729ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e2d4590-a0af-4a3d-ad90-409cb7365864", "content-length": "169", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114372025-01-30T20:27:31.729ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
114382025-01-30T20:27:31.730ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fc8a7b9-9885-4571-bc13-c2ea66a724a4", "content-length": "178", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114392025-01-30T20:27:31.730ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
114402025-01-30T20:27:31.730ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc1ca6ac-ea61-4ca2-a94f-4d304b7d3bb3", "content-length": "178", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114412025-01-30T20:27:31.731ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
114422025-01-30T20:27:31.731ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "12a7924a-5429-4ec3-906a-7bca5c05eb3b", "content-length": "702", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114432025-01-30T20:27:31.731ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
114442025-01-30T20:27:31.732ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ef02fe5-2c0a-494f-8a94-d18a08e8da35", "content-length": "727", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114452025-01-30T20:27:31.732ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
114462025-01-30T20:27:31.732ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2244c5e5-22f4-4ac2-92eb-8405b6a76511", "content-length": "729", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114472025-01-30T20:27:31.732ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
114482025-01-30T20:27:31.733ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e897425-8fe9-49b3-83bc-7b32dc032d2a", "content-length": "728", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114492025-01-30T20:27:31.733ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
114502025-01-30T20:27:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
114512025-01-30T20:27:31.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114522025-01-30T20:27:31.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
114532025-01-30T20:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
114542025-01-30T20:27:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
114552025-01-30T20:27:31.739ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114562025-01-30T20:27:31.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
114572025-01-30T20:27:31.743ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
114582025-01-30T20:27:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
114592025-01-30T20:27:31.793ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, time_created: 2025-01-30T20:18:10.641871Z, time_modified: 2025-01-30T20:18:10.641871Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
114602025-01-30T20:27:31.793ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
114612025-01-30T20:27:31.793ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114622025-01-30T20:27:31.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114632025-01-30T20:27:31.796ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114642025-01-30T20:27:31.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114652025-01-30T20:27:31.797ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114662025-01-30T20:27:31.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = de9963be-f7a5-4a8b-89f9-b0c8d4070b7c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
114672025-01-30T20:27:31.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = de9963be-f7a5-4a8b-89f9-b0c8d4070b7c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
114682025-01-30T20:27:31.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
114692025-01-30T20:27:31.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = de9963be-f7a5-4a8b-89f9-b0c8d4070b7c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
114702025-01-30T20:27:31.831ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
114712025-01-30T20:27:31.831ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6060ac23-a403-4815-9f8f-22086b65a426", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
114722025-01-30T20:27:31.832ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
114732025-01-30T20:27:31.833ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a44c74ff-0922-47a9-88d7-82e85470c3b4", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
114742025-01-30T20:27:31.833ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
114752025-01-30T20:27:31.835ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f6f89180-9d95-486f-be0d-b226d6bf0d5d", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
114762025-01-30T20:27:31.835ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
114772025-01-30T20:27:31.837ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
114782025-01-30T20:27:31.837ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.03624214s iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
114792025-01-30T20:27:31.884ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
114802025-01-30T20:27:31.890ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "28714e07-cc67-47bc-b270-53371ee72242", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114812025-01-30T20:27:31.892ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
114822025-01-30T20:27:31.892ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 1.090416714s
114832025-01-30T20:27:31.892ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 1.090427424s iteration = 3 status = {}
114842025-01-30T20:27:31.893ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
114852025-01-30T20:27:31.893ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
114862025-01-30T20:27:31.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114872025-01-30T20:27:31.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114882025-01-30T20:27:31.903ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
114892025-01-30T20:27:31.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114902025-01-30T20:27:31.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114912025-01-30T20:27:31.913ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
114922025-01-30T20:27:31.913ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4bcdfe5-7c1c-468b-8a4e-7b2541b03e52", "content-length": "134", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
114932025-01-30T20:27:31.913ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
114942025-01-30T20:27:31.913ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
114952025-01-30T20:27:31.914ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
114962025-01-30T20:27:31.914ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
114972025-01-30T20:27:31.914ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114982025-01-30T20:27:31.914ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114992025-01-30T20:27:31.914ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115002025-01-30T20:27:31.914ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115012025-01-30T20:27:31.914ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115022025-01-30T20:27:31.914ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115032025-01-30T20:27:31.914ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
115042025-01-30T20:27:31.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115052025-01-30T20:27:31.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115062025-01-30T20:27:31.917ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
115072025-01-30T20:27:31.917ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1f90ff4-4340-4ec0-9b5b-95c5eb32446d", "content-length": "2", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
115082025-01-30T20:27:31.917ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
115092025-01-30T20:27:31.917ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "77411dae-1a81-45d3-9381-ce15e65517a9", "content-length": "52", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
115102025-01-30T20:27:31.917ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
115112025-01-30T20:27:31.917ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
115122025-01-30T20:27:32.055ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "804bdc49-f1ed-436f-bbb5-c20af6397582", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
115132025-01-30T20:27:32.055ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
115142025-01-30T20:27:32.055ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
115152025-01-30T20:27:32.059ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5baec48c-5bc3-4f87-b36a-14a56869d898", "content-length": "682", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
115162025-01-30T20:27:32.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115172025-01-30T20:27:32.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115182025-01-30T20:27:32.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115192025-01-30T20:27:32.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115202025-01-30T20:27:32.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115212025-01-30T20:27:32.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115222025-01-30T20:27:32.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115232025-01-30T20:27:32.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115242025-01-30T20:27:32.077ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.27655543s iteration = 21 status = {}
115252025-01-30T20:27:32.311ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "b517cd13-270a-4b18-84ab-633f981fc8b4", "content-length": "30796", "date": "Thu, 30 Jan 2025 20:27:31 GMT"} })
115262025-01-30T20:27:32.313ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
115272025-01-30T20:27:32.313ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
115282025-01-30T20:27:32.313ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
115292025-01-30T20:27:32.315ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115302025-01-30T20:27:32.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115312025-01-30T20:27:32.317ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115322025-01-30T20:27:32.319ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
115332025-01-30T20:27:32.319ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115342025-01-30T20:27:32.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115352025-01-30T20:27:32.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2358de5f-bcbb-49f2-899d-e6a9d6a987dd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115362025-01-30T20:27:32.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2358de5f-bcbb-49f2-899d-e6a9d6a987dd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115372025-01-30T20:27:32.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2358de5f-bcbb-49f2-899d-e6a9d6a987dd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115382025-01-30T20:27:32.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 513 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = b6383752-305b-4f7b-b20b-3fd72987fe79 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
115392025-01-30T20:27:32.492ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = c206eea7-1a6c-4ff1-9b9c-9aeedf194989 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
115402025-01-30T20:27:32.492ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = c206eea7-1a6c-4ff1-9b9c-9aeedf194989 time_started = 2025-01-30 20:27:31.724193 UTC
115412025-01-30T20:27:32.492ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
115422025-01-30T20:27:32.492ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.690758386s iteration = 3 status = {"collection_id":"c206eea7-1a6c-4ff1-9b9c-9aeedf194989","time_done":"2025-01-30 20:27:32.313573 UTC","time_started":"2025-01-30 20:27:31.724193 UTC"}
115432025-01-30T20:27:32.492ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
115442025-01-30T20:27:32.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115452025-01-30T20:27:32.492ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115462025-01-30T20:27:32.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115472025-01-30T20:27:32.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115482025-01-30T20:27:32.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115492025-01-30T20:27:32.494ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115502025-01-30T20:27:32.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115512025-01-30T20:27:32.497ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115522025-01-30T20:27:32.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115532025-01-30T20:27:32.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
115542025-01-30T20:27:32.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115552025-01-30T20:27:32.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115562025-01-30T20:27:32.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115572025-01-30T20:27:32.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115582025-01-30T20:27:32.500ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115592025-01-30T20:27:32.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115602025-01-30T20:27:32.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115612025-01-30T20:27:32.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115622025-01-30T20:27:32.503ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115632025-01-30T20:27:32.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115642025-01-30T20:27:32.524ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115652025-01-30T20:27:32.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115662025-01-30T20:27:32.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115672025-01-30T20:27:32.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
115682025-01-30T20:27:32.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115692025-01-30T20:27:32.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115702025-01-30T20:27:32.529ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115712025-01-30T20:27:32.531ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
115722025-01-30T20:27:32.531ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115732025-01-30T20:27:32.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115742025-01-30T20:27:32.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115752025-01-30T20:27:32.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115762025-01-30T20:27:32.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115772025-01-30T20:27:32.537ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
115782025-01-30T20:27:32.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115792025-01-30T20:27:32.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115802025-01-30T20:27:32.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115812025-01-30T20:27:32.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
115822025-01-30T20:27:32.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115832025-01-30T20:27:32.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115842025-01-30T20:27:32.542ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 50.125982ms iteration = 24 status = {"physical_disks_added":0}
115852025-01-30T20:27:32.543ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
115862025-01-30T20:27:32.543ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 51.034756ms iteration = 6 status = {"blueprint_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","inventory_collection_id":"c206eea7-1a6c-4ff1-9b9c-9aeedf194989","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
115872025-01-30T20:27:33.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = af6ff31b-2f8e-4d99-934c-85ddbbd0295c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115882025-01-30T20:27:33.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = af6ff31b-2f8e-4d99-934c-85ddbbd0295c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115892025-01-30T20:27:33.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = af6ff31b-2f8e-4d99-934c-85ddbbd0295c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115902025-01-30T20:27:34.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b0aa8828-986d-4948-a7e4-a7aa02b1940a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115912025-01-30T20:27:34.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b0aa8828-986d-4948-a7e4-a7aa02b1940a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115922025-01-30T20:27:34.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b0aa8828-986d-4948-a7e4-a7aa02b1940a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115932025-01-30T20:27:35.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c296687f-fa95-40af-969e-a8a906b4b972 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115942025-01-30T20:27:35.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c296687f-fa95-40af-969e-a8a906b4b972 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115952025-01-30T20:27:35.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c296687f-fa95-40af-969e-a8a906b4b972 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115962025-01-30T20:27:36.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 448bf58a-2490-4d21-b62f-f3704093342c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115972025-01-30T20:27:36.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 448bf58a-2490-4d21-b62f-f3704093342c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115982025-01-30T20:27:36.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 448bf58a-2490-4d21-b62f-f3704093342c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
115992025-01-30T20:27:37.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9f699569-7f2b-4bff-8d7d-73d1c871c24f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116002025-01-30T20:27:37.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9f699569-7f2b-4bff-8d7d-73d1c871c24f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116012025-01-30T20:27:37.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9f699569-7f2b-4bff-8d7d-73d1c871c24f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116022025-01-30T20:27:38.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 977c7c38-1d1e-4b3d-a110-8f4359f793c6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116032025-01-30T20:27:38.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 977c7c38-1d1e-4b3d-a110-8f4359f793c6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116042025-01-30T20:27:38.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 977c7c38-1d1e-4b3d-a110-8f4359f793c6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116052025-01-30T20:27:39.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 134f216e-e2de-4ab0-b365-a9c998b80aed roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116062025-01-30T20:27:39.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 134f216e-e2de-4ab0-b365-a9c998b80aed resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116072025-01-30T20:27:39.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 134f216e-e2de-4ab0-b365-a9c998b80aed response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116082025-01-30T20:27:40.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 79ea5e28-2fb6-4413-96b5-37c34d7bc30b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116092025-01-30T20:27:40.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 79ea5e28-2fb6-4413-96b5-37c34d7bc30b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116102025-01-30T20:27:40.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 79ea5e28-2fb6-4413-96b5-37c34d7bc30b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116112025-01-30T20:27:40.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
116122025-01-30T20:27:40.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
116132025-01-30T20:27:40.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116142025-01-30T20:27:40.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116152025-01-30T20:27:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116162025-01-30T20:27:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116172025-01-30T20:27:40.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116182025-01-30T20:27:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116192025-01-30T20:27:40.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116202025-01-30T20:27:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116212025-01-30T20:27:40.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116222025-01-30T20:27:40.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116232025-01-30T20:27:40.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116242025-01-30T20:27:40.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
116252025-01-30T20:27:40.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116262025-01-30T20:27:40.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116272025-01-30T20:27:40.827ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
116282025-01-30T20:27:40.827ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.046703ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
116292025-01-30T20:27:40.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116302025-01-30T20:27:40.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116312025-01-30T20:27:40.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.034945ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116322025-01-30T20:27:41.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c1b6faea-4b2a-4213-889b-7d644e05acba roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116332025-01-30T20:27:41.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c1b6faea-4b2a-4213-889b-7d644e05acba resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116342025-01-30T20:27:41.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c1b6faea-4b2a-4213-889b-7d644e05acba response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116352025-01-30T20:27:42.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 530 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 961991f3-645e-4e28-a1ad-46b846f6a8ab response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
116362025-01-30T20:27:42.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 84f106b7-ce65-4671-b9da-a2517e7b4348 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116372025-01-30T20:27:42.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 84f106b7-ce65-4671-b9da-a2517e7b4348 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116382025-01-30T20:27:42.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 84f106b7-ce65-4671-b9da-a2517e7b4348 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116392025-01-30T20:27:43.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a293ecc6-414d-4565-aa29-49f68e0e007b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116402025-01-30T20:27:43.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a293ecc6-414d-4565-aa29-49f68e0e007b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116412025-01-30T20:27:43.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a293ecc6-414d-4565-aa29-49f68e0e007b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116422025-01-30T20:27:44.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 756d8a23-cb9b-4623-bdec-93b5f47b1e56 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116432025-01-30T20:27:44.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 756d8a23-cb9b-4623-bdec-93b5f47b1e56 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116442025-01-30T20:27:44.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 756d8a23-cb9b-4623-bdec-93b5f47b1e56 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116452025-01-30T20:27:45.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f144f54c-72c8-416f-8d57-026df938baee roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116462025-01-30T20:27:45.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f144f54c-72c8-416f-8d57-026df938baee resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116472025-01-30T20:27:45.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f144f54c-72c8-416f-8d57-026df938baee response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116482025-01-30T20:27:46.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 75e47cfb-078a-480f-8784-75179cb0aa81 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116492025-01-30T20:27:46.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 75e47cfb-078a-480f-8784-75179cb0aa81 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116502025-01-30T20:27:46.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 75e47cfb-078a-480f-8784-75179cb0aa81 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116512025-01-30T20:27:47.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = cf329bcb-9641-4253-a8c5-f57a96998849 roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
116522025-01-30T20:27:47.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = cf329bcb-9641-4253-a8c5-f57a96998849 resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
116532025-01-30T20:27:47.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = cf329bcb-9641-4253-a8c5-f57a96998849 response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?sort_by=id_ascending
116542025-01-30T20:27:47.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = d8733946-ddd6-4e52-87f7-344d199fec1f roles = RoleSet { roles: {} } uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
116552025-01-30T20:27:47.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = d8733946-ddd6-4e52-87f7-344d199fec1f resource = Database result = Ok(()) uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
116562025-01-30T20:27:47.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50185 req_id = d8733946-ddd6-4e52-87f7-344d199fec1f response_code = 200 uri = /metrics/collectors/623434f7-1950-4ff8-a21d-872e401e4248/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYWI0YzljNC1hZmY1LTQxZGUtYTc3My1hNzZhZGU0MGNiMGYifX0%3D
116572025-01-30T20:27:47.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 16d81c1b-54fd-46cb-a2b3-699c9f8fb1d6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116582025-01-30T20:27:47.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 16d81c1b-54fd-46cb-a2b3-699c9f8fb1d6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116592025-01-30T20:27:47.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 16d81c1b-54fd-46cb-a2b3-699c9f8fb1d6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116602025-01-30T20:27:48.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 60e681e3-0a9c-497f-9d6d-cf496649222e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116612025-01-30T20:27:48.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 60e681e3-0a9c-497f-9d6d-cf496649222e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116622025-01-30T20:27:48.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 60e681e3-0a9c-497f-9d6d-cf496649222e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116632025-01-30T20:27:49.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 76b123cc-d7a9-4952-bdf3-978fbba8f386 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116642025-01-30T20:27:49.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 76b123cc-d7a9-4952-bdf3-978fbba8f386 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116652025-01-30T20:27:49.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 76b123cc-d7a9-4952-bdf3-978fbba8f386 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116662025-01-30T20:27:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
116672025-01-30T20:27:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116682025-01-30T20:27:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
116692025-01-30T20:27:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116702025-01-30T20:27:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116712025-01-30T20:27:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116722025-01-30T20:27:50.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116732025-01-30T20:27:50.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dee3b1d4-d2b5-4b30-b6c8-79c623ea0f5f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116742025-01-30T20:27:50.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dee3b1d4-d2b5-4b30-b6c8-79c623ea0f5f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116752025-01-30T20:27:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116762025-01-30T20:27:50.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116772025-01-30T20:27:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116782025-01-30T20:27:50.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dee3b1d4-d2b5-4b30-b6c8-79c623ea0f5f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116792025-01-30T20:27:50.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116802025-01-30T20:27:50.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116812025-01-30T20:27:50.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116822025-01-30T20:27:50.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
116832025-01-30T20:27:50.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116842025-01-30T20:27:50.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116852025-01-30T20:27:50.827ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
116862025-01-30T20:27:50.827ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.860218ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
116872025-01-30T20:27:50.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116882025-01-30T20:27:50.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116892025-01-30T20:27:50.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.407427ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116902025-01-30T20:27:51.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5a775b28-ac40-491c-828f-b54cd1d9adac roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116912025-01-30T20:27:51.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5a775b28-ac40-491c-828f-b54cd1d9adac resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116922025-01-30T20:27:51.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5a775b28-ac40-491c-828f-b54cd1d9adac response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116932025-01-30T20:27:52.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 548 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = e8f2bc4b-7b1b-46d3-af77-643d459ed6d9 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
116942025-01-30T20:27:52.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3b65f5ce-a077-4dca-b5de-280ac5c5fd59 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116952025-01-30T20:27:52.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3b65f5ce-a077-4dca-b5de-280ac5c5fd59 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116962025-01-30T20:27:52.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3b65f5ce-a077-4dca-b5de-280ac5c5fd59 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116972025-01-30T20:27:53.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 701f4eec-ea08-48e6-9f79-67ee0823af7d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116982025-01-30T20:27:53.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 701f4eec-ea08-48e6-9f79-67ee0823af7d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
116992025-01-30T20:27:53.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 701f4eec-ea08-48e6-9f79-67ee0823af7d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117002025-01-30T20:27:54.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 60b8f7bb-5933-4627-818b-4c1636ec57e5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117012025-01-30T20:27:54.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 60b8f7bb-5933-4627-818b-4c1636ec57e5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117022025-01-30T20:27:54.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 60b8f7bb-5933-4627-818b-4c1636ec57e5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117032025-01-30T20:27:55.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3a586a90-204b-4e03-a2b4-51097178af84 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117042025-01-30T20:27:55.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3a586a90-204b-4e03-a2b4-51097178af84 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117052025-01-30T20:27:55.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3a586a90-204b-4e03-a2b4-51097178af84 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117062025-01-30T20:27:56.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0914c43e-eb94-40ef-8071-f9ca265af909 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117072025-01-30T20:27:56.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0914c43e-eb94-40ef-8071-f9ca265af909 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117082025-01-30T20:27:56.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0914c43e-eb94-40ef-8071-f9ca265af909 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117092025-01-30T20:27:57.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 10530887-7ae1-4116-a70c-f7f32859d786 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117102025-01-30T20:27:57.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 10530887-7ae1-4116-a70c-f7f32859d786 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117112025-01-30T20:27:57.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 10530887-7ae1-4116-a70c-f7f32859d786 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117122025-01-30T20:27:58.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4d02ff3f-08b9-49e1-b55e-3c6554535bdd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117132025-01-30T20:27:58.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4d02ff3f-08b9-49e1-b55e-3c6554535bdd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117142025-01-30T20:27:58.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4d02ff3f-08b9-49e1-b55e-3c6554535bdd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117152025-01-30T20:28:00.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 38653643-05e1-40a7-9a15-69bb68a13fca roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117162025-01-30T20:28:00.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 38653643-05e1-40a7-9a15-69bb68a13fca resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117172025-01-30T20:28:00.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 38653643-05e1-40a7-9a15-69bb68a13fca response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
117182025-01-30T20:28:00.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
117192025-01-30T20:28:00.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
117202025-01-30T20:28:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117212025-01-30T20:28:00.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
117222025-01-30T20:28:00.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
117232025-01-30T20:28:00.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
117242025-01-30T20:28:00.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
117252025-01-30T20:28:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117262025-01-30T20:28:00.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
117272025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
117282025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
117292025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117302025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
117312025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
117322025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
117332025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117342025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117352025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
117362025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
117372025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117382025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
117392025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
117402025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
117412025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
117422025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117432025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
117442025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117452025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
117462025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117472025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
117482025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
117492025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117502025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
117512025-01-30T20:28:00.802ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
117522025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117532025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
117542025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
117552025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117562025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
117572025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
117582025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117592025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117602025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
117612025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
117622025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117632025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
117642025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117652025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117662025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117672025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117682025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117692025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
117702025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117712025-01-30T20:28:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117722025-01-30T20:28:00.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117732025-01-30T20:28:00.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2832, tv_nsec: 14694615 } })
117742025-01-30T20:28:00.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
117752025-01-30T20:28:00.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.765125ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
117762025-01-30T20:28:00.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2832, tv_nsec: 15374604 } })
117772025-01-30T20:28:00.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117782025-01-30T20:28:00.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
117792025-01-30T20:28:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
117802025-01-30T20:28:00.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117812025-01-30T20:28:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117822025-01-30T20:28:00.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.999437ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
117832025-01-30T20:28:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117842025-01-30T20:28:00.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117852025-01-30T20:28:00.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117862025-01-30T20:28:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117872025-01-30T20:28:00.810ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117882025-01-30T20:28:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117892025-01-30T20:28:00.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
117902025-01-30T20:28:00.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117912025-01-30T20:28:00.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117922025-01-30T20:28:00.813ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117932025-01-30T20:28:00.814ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117942025-01-30T20:28:00.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117952025-01-30T20:28:00.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117962025-01-30T20:28:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
117972025-01-30T20:28:00.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117982025-01-30T20:28:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117992025-01-30T20:28:00.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
118002025-01-30T20:28:00.816ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
118012025-01-30T20:28:00.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
118022025-01-30T20:28:00.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118032025-01-30T20:28:00.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118042025-01-30T20:28:00.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118052025-01-30T20:28:00.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118062025-01-30T20:28:00.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118072025-01-30T20:28:00.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118082025-01-30T20:28:00.818ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2832, tv_nsec: 27545932 } })
118092025-01-30T20:28:00.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118102025-01-30T20:28:00.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
118112025-01-30T20:28:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118122025-01-30T20:28:00.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118132025-01-30T20:28:00.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118142025-01-30T20:28:00.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118152025-01-30T20:28:00.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118162025-01-30T20:28:00.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118172025-01-30T20:28:00.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118182025-01-30T20:28:00.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118192025-01-30T20:28:00.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118202025-01-30T20:28:00.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118212025-01-30T20:28:00.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118222025-01-30T20:28:00.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118232025-01-30T20:28:00.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118242025-01-30T20:28:00.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 37.515171ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
118252025-01-30T20:28:00.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
118262025-01-30T20:28:00.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
118272025-01-30T20:28:00.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118282025-01-30T20:28:00.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118292025-01-30T20:28:00.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118302025-01-30T20:28:00.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118312025-01-30T20:28:00.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118322025-01-30T20:28:00.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
118332025-01-30T20:28:00.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118342025-01-30T20:28:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118352025-01-30T20:28:00.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118362025-01-30T20:28:00.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.596841ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118372025-01-30T20:28:00.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118382025-01-30T20:28:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118392025-01-30T20:28:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
118402025-01-30T20:28:00.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118412025-01-30T20:28:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118422025-01-30T20:28:00.854ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 52.96727ms iteration = 22 status = 0
118432025-01-30T20:28:00.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.260434ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118442025-01-30T20:28:00.858ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
118452025-01-30T20:28:00.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
118462025-01-30T20:28:00.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118472025-01-30T20:28:00.861ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118482025-01-30T20:28:00.863ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118492025-01-30T20:28:00.863ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
118502025-01-30T20:28:00.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118512025-01-30T20:28:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118522025-01-30T20:28:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
118532025-01-30T20:28:00.864ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
118542025-01-30T20:28:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
118552025-01-30T20:28:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
118562025-01-30T20:28:00.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118572025-01-30T20:28:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118582025-01-30T20:28:00.866ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118592025-01-30T20:28:00.866ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
118602025-01-30T20:28:00.866ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118612025-01-30T20:28:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118622025-01-30T20:28:00.872ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
118632025-01-30T20:28:00.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.813805ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
118642025-01-30T20:28:00.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.70834ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118652025-01-30T20:28:00.883ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
118662025-01-30T20:28:00.883ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.068198ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
118672025-01-30T20:28:00.887ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118682025-01-30T20:28:00.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118692025-01-30T20:28:00.899ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
118702025-01-30T20:28:00.899ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118712025-01-30T20:28:00.899ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "07e56883-ad8e-4b17-9907-5aa6d1c7a844", "content-length": "26", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
118722025-01-30T20:28:00.899ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118732025-01-30T20:28:00.901ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118742025-01-30T20:28:00.902ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
118752025-01-30T20:28:00.902ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 100.380156ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
118762025-01-30T20:28:00.905ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118772025-01-30T20:28:00.905ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
118782025-01-30T20:28:00.905ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 103.42153ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
118792025-01-30T20:28:00.908ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
118802025-01-30T20:28:00.908ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118812025-01-30T20:28:00.908ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8362c110-0026-48e6-b8f4-4b822aa36e73", "content-length": "26", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
118822025-01-30T20:28:00.908ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118832025-01-30T20:28:00.910ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118842025-01-30T20:28:00.921ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
118852025-01-30T20:28:00.921ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118862025-01-30T20:28:00.921ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8794cdbf-1e3f-4ae8-853e-31d9e0cbdeee", "content-length": "26", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
118872025-01-30T20:28:00.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118882025-01-30T20:28:00.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
118892025-01-30T20:28:00.938ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 135.946633ms iteration = 25 status = {"physical_disks_added":0}
118902025-01-30T20:28:00.959ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118912025-01-30T20:28:00.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118922025-01-30T20:28:00.982ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
118932025-01-30T20:28:00.982ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118942025-01-30T20:28:00.983ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "66f0b371-46fd-4ecf-84f5-7caa979f8bed", "content-length": "372", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
118952025-01-30T20:28:00.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118962025-01-30T20:28:00.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118972025-01-30T20:28:00.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 182.594648ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
118982025-01-30T20:28:00.984ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118992025-01-30T20:28:00.986ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119002025-01-30T20:28:00.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119012025-01-30T20:28:00.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119022025-01-30T20:28:00.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119032025-01-30T20:28:00.990ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 188.112151ms iteration = 22 status = {}
119042025-01-30T20:28:00.990ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119052025-01-30T20:28:00.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119062025-01-30T20:28:00.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119072025-01-30T20:28:00.993ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
119082025-01-30T20:28:00.993ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff54c475-cdd3-42f0-9ca1-8744ff0f3afc", "content-length": "1", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
119092025-01-30T20:28:00.995ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
119102025-01-30T20:28:00.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
119112025-01-30T20:28:00.997ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 195.61594ms iteration = 22 status = null
119122025-01-30T20:28:01.023ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
119132025-01-30T20:28:01.023ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
119142025-01-30T20:28:01.023ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "133cd884-dfda-47c9-9871-6f4a9a1b484a", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
119152025-01-30T20:28:01.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119162025-01-30T20:28:01.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119172025-01-30T20:28:01.025ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119182025-01-30T20:28:01.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119192025-01-30T20:28:01.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 90679db4-5b08-495b-b1e9-8afc3a954e2b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119202025-01-30T20:28:01.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 90679db4-5b08-495b-b1e9-8afc3a954e2b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119212025-01-30T20:28:01.053ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
119222025-01-30T20:28:01.054ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cce3bf3-22be-4ccb-b1d5-96f298fd9b03", "content-length": "691", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
119232025-01-30T20:28:01.054ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
119242025-01-30T20:28:01.054ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
119252025-01-30T20:28:01.054ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
119262025-01-30T20:28:01.055ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 253.380412ms iteration = 22 status = {}
119272025-01-30T20:28:01.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 20205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 90679db4-5b08-495b-b1e9-8afc3a954e2b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119282025-01-30T20:28:01.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119292025-01-30T20:28:01.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119302025-01-30T20:28:01.058ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
119312025-01-30T20:28:01.058ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119322025-01-30T20:28:01.063ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d6c50229-78c1-4f2d-a682-4d994e5f56da", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
119332025-01-30T20:28:01.065ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 263.185374ms iteration = 22 status = {}
119342025-01-30T20:28:01.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119352025-01-30T20:28:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119362025-01-30T20:28:01.091ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
119372025-01-30T20:28:01.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119382025-01-30T20:28:01.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119392025-01-30T20:28:01.100ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
119402025-01-30T20:28:01.100ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "84001bee-66cb-4260-b47a-5f05c6abce26", "content-length": "134", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
119412025-01-30T20:28:01.100ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
119422025-01-30T20:28:01.100ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
119432025-01-30T20:28:01.100ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
119442025-01-30T20:28:01.100ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
119452025-01-30T20:28:01.100ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119462025-01-30T20:28:01.100ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119472025-01-30T20:28:01.100ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119482025-01-30T20:28:01.100ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119492025-01-30T20:28:01.100ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119502025-01-30T20:28:01.100ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119512025-01-30T20:28:01.100ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
119522025-01-30T20:28:01.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119532025-01-30T20:28:01.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119542025-01-30T20:28:01.103ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
119552025-01-30T20:28:01.103ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a383089c-8f91-4825-9536-e880c0a05f0a", "content-length": "2", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
119562025-01-30T20:28:01.103ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
119572025-01-30T20:28:01.103ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "45f1e651-b49b-4b34-908a-e23f55737ab3", "content-length": "52", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
119582025-01-30T20:28:01.103ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
119592025-01-30T20:28:01.103ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
119602025-01-30T20:28:01.238ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "327336e0-6001-4852-8e6b-0c465b28ab2d", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
119612025-01-30T20:28:01.238ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
119622025-01-30T20:28:01.238ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
119632025-01-30T20:28:01.238ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "05feda51-d97f-4969-8d69-7f0cc1e5bdf5", "content-length": "682", "date": "Thu, 30 Jan 2025 20:28:00 GMT"} })
119642025-01-30T20:28:01.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119652025-01-30T20:28:01.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119662025-01-30T20:28:01.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119672025-01-30T20:28:01.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119682025-01-30T20:28:01.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119692025-01-30T20:28:01.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119702025-01-30T20:28:01.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119712025-01-30T20:28:01.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119722025-01-30T20:28:01.261ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 459.672728ms iteration = 22 status = {}
119732025-01-30T20:28:01.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 38c6895e-0763-4c60-b70e-e73c3fd0e89a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
119742025-01-30T20:28:01.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 38c6895e-0763-4c60-b70e-e73c3fd0e89a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
119752025-01-30T20:28:01.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 38c6895e-0763-4c60-b70e-e73c3fd0e89a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
119762025-01-30T20:28:02.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b35ee6d6-fd93-4bf4-a16f-3746cc6a9083 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119772025-01-30T20:28:02.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b35ee6d6-fd93-4bf4-a16f-3746cc6a9083 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119782025-01-30T20:28:02.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b35ee6d6-fd93-4bf4-a16f-3746cc6a9083 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119792025-01-30T20:28:02.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 578 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = dba97693-9705-499f-a055-707c0f9e3cf8 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
119802025-01-30T20:28:03.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c2f226e8-3e2e-4750-ba12-19c9f6ccfb81 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119812025-01-30T20:28:03.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c2f226e8-3e2e-4750-ba12-19c9f6ccfb81 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119822025-01-30T20:28:03.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c2f226e8-3e2e-4750-ba12-19c9f6ccfb81 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119832025-01-30T20:28:04.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8a0dd5c5-649e-4ebb-8642-1f5d0d8a02cf roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119842025-01-30T20:28:04.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8a0dd5c5-649e-4ebb-8642-1f5d0d8a02cf resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119852025-01-30T20:28:04.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8a0dd5c5-649e-4ebb-8642-1f5d0d8a02cf response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119862025-01-30T20:28:05.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5ab02133-691f-4d98-8cde-f9e91bad172f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119872025-01-30T20:28:05.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5ab02133-691f-4d98-8cde-f9e91bad172f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119882025-01-30T20:28:05.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5ab02133-691f-4d98-8cde-f9e91bad172f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119892025-01-30T20:28:06.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 03ccd774-f0ee-4f33-a02f-ea0f4492150f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119902025-01-30T20:28:06.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 03ccd774-f0ee-4f33-a02f-ea0f4492150f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119912025-01-30T20:28:06.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 03ccd774-f0ee-4f33-a02f-ea0f4492150f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119922025-01-30T20:28:07.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7b4af852-7b14-4a61-8036-8ebfc4de309c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119932025-01-30T20:28:07.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7b4af852-7b14-4a61-8036-8ebfc4de309c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119942025-01-30T20:28:07.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7b4af852-7b14-4a61-8036-8ebfc4de309c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119952025-01-30T20:28:08.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 937cbe6f-ffe8-4b54-bb96-ca67292e313c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119962025-01-30T20:28:08.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 937cbe6f-ffe8-4b54-bb96-ca67292e313c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119972025-01-30T20:28:08.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 937cbe6f-ffe8-4b54-bb96-ca67292e313c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119982025-01-30T20:28:09.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2be7311e-c608-4c14-a89d-3349fed7f15c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
119992025-01-30T20:28:09.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2be7311e-c608-4c14-a89d-3349fed7f15c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120002025-01-30T20:28:09.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2be7311e-c608-4c14-a89d-3349fed7f15c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120012025-01-30T20:28:10.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 916dfe69-4a50-4274-9828-1b246e857621 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120022025-01-30T20:28:10.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 916dfe69-4a50-4274-9828-1b246e857621 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120032025-01-30T20:28:10.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 916dfe69-4a50-4274-9828-1b246e857621 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120042025-01-30T20:28:10.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
120052025-01-30T20:28:10.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
120062025-01-30T20:28:10.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120072025-01-30T20:28:10.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120082025-01-30T20:28:10.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120092025-01-30T20:28:10.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120102025-01-30T20:28:10.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120112025-01-30T20:28:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120122025-01-30T20:28:10.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120132025-01-30T20:28:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120142025-01-30T20:28:10.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120152025-01-30T20:28:10.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120162025-01-30T20:28:10.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120172025-01-30T20:28:10.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
120182025-01-30T20:28:10.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120192025-01-30T20:28:10.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120202025-01-30T20:28:10.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
120212025-01-30T20:28:10.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.572701ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
120222025-01-30T20:28:10.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120232025-01-30T20:28:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120242025-01-30T20:28:10.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.134714ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120252025-01-30T20:28:11.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f838672a-3b26-4a30-bc1e-3ae20a7a836a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120262025-01-30T20:28:11.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f838672a-3b26-4a30-bc1e-3ae20a7a836a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120272025-01-30T20:28:11.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f838672a-3b26-4a30-bc1e-3ae20a7a836a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120282025-01-30T20:28:12.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dfd6b69f-6b71-40e2-8d1b-8957fcbdbff8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120292025-01-30T20:28:12.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dfd6b69f-6b71-40e2-8d1b-8957fcbdbff8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120302025-01-30T20:28:12.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dfd6b69f-6b71-40e2-8d1b-8957fcbdbff8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120312025-01-30T20:28:12.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 480 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 5628ed6f-3ed1-4537-aa02-c4e12e22f116 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
120322025-01-30T20:28:13.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7c4699b-3d85-4336-adf1-299de046bd53 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120332025-01-30T20:28:13.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7c4699b-3d85-4336-adf1-299de046bd53 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120342025-01-30T20:28:13.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d7c4699b-3d85-4336-adf1-299de046bd53 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120352025-01-30T20:28:14.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f671333f-84da-48cc-b6ab-04c4fc76fd5f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120362025-01-30T20:28:14.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f671333f-84da-48cc-b6ab-04c4fc76fd5f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120372025-01-30T20:28:14.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f671333f-84da-48cc-b6ab-04c4fc76fd5f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120382025-01-30T20:28:15.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 592ac009-5bfa-4850-b887-2c5cd7b39a51 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120392025-01-30T20:28:15.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 592ac009-5bfa-4850-b887-2c5cd7b39a51 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120402025-01-30T20:28:15.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 592ac009-5bfa-4850-b887-2c5cd7b39a51 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120412025-01-30T20:28:16.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8cda7213-27b7-4aa9-96b3-0518abc82212 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120422025-01-30T20:28:16.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8cda7213-27b7-4aa9-96b3-0518abc82212 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120432025-01-30T20:28:16.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8cda7213-27b7-4aa9-96b3-0518abc82212 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120442025-01-30T20:28:17.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2186e799-4991-48b1-9658-980c90caf8cb roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120452025-01-30T20:28:17.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2186e799-4991-48b1-9658-980c90caf8cb resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120462025-01-30T20:28:17.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2186e799-4991-48b1-9658-980c90caf8cb response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120472025-01-30T20:28:18.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ab5a78a8-7dd5-47f4-8962-6d75afbffe69 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120482025-01-30T20:28:18.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ab5a78a8-7dd5-47f4-8962-6d75afbffe69 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120492025-01-30T20:28:18.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ab5a78a8-7dd5-47f4-8962-6d75afbffe69 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120502025-01-30T20:28:19.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b976b0ff-dd6e-4ae6-8735-453259fc1f93 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120512025-01-30T20:28:19.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b976b0ff-dd6e-4ae6-8735-453259fc1f93 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120522025-01-30T20:28:19.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b976b0ff-dd6e-4ae6-8735-453259fc1f93 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120532025-01-30T20:28:20.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f8c126c5-0eae-4d69-8aca-a88ab9d51b90 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120542025-01-30T20:28:20.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f8c126c5-0eae-4d69-8aca-a88ab9d51b90 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120552025-01-30T20:28:20.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f8c126c5-0eae-4d69-8aca-a88ab9d51b90 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120562025-01-30T20:28:20.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
120572025-01-30T20:28:20.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120582025-01-30T20:28:20.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
120592025-01-30T20:28:20.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120602025-01-30T20:28:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120612025-01-30T20:28:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120622025-01-30T20:28:20.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120632025-01-30T20:28:20.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120642025-01-30T20:28:20.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120652025-01-30T20:28:20.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.532578ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120662025-01-30T20:28:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120672025-01-30T20:28:20.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120682025-01-30T20:28:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120692025-01-30T20:28:20.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120702025-01-30T20:28:20.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120712025-01-30T20:28:20.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120722025-01-30T20:28:20.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
120732025-01-30T20:28:20.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120742025-01-30T20:28:20.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120752025-01-30T20:28:20.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
120762025-01-30T20:28:20.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.969054ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
120772025-01-30T20:28:21.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5ca7b151-f47d-4163-9138-b9dfa5e6f2b3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120782025-01-30T20:28:21.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5ca7b151-f47d-4163-9138-b9dfa5e6f2b3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120792025-01-30T20:28:21.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5ca7b151-f47d-4163-9138-b9dfa5e6f2b3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120802025-01-30T20:28:22.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 525 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = c3e90f4a-7027-4415-b588-8152a43f6423 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
120812025-01-30T20:28:22.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d4cb82e9-7025-4c3c-bed1-dc4e5d19ff48 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120822025-01-30T20:28:22.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d4cb82e9-7025-4c3c-bed1-dc4e5d19ff48 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120832025-01-30T20:28:22.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d4cb82e9-7025-4c3c-bed1-dc4e5d19ff48 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120842025-01-30T20:28:23.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 80908026-34ac-47cf-8c0e-e4a3f45c8446 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120852025-01-30T20:28:23.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 80908026-34ac-47cf-8c0e-e4a3f45c8446 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120862025-01-30T20:28:23.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 80908026-34ac-47cf-8c0e-e4a3f45c8446 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120872025-01-30T20:28:24.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3dba03b4-bbed-49ec-9e3b-dd0e3d635f55 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120882025-01-30T20:28:24.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3dba03b4-bbed-49ec-9e3b-dd0e3d635f55 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120892025-01-30T20:28:24.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3dba03b4-bbed-49ec-9e3b-dd0e3d635f55 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120902025-01-30T20:28:25.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9dc6556c-e362-4c93-9667-1983af807c30 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120912025-01-30T20:28:25.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9dc6556c-e362-4c93-9667-1983af807c30 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120922025-01-30T20:28:25.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9dc6556c-e362-4c93-9667-1983af807c30 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120932025-01-30T20:28:26.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 83df5a27-9cbf-4794-810b-713dfdb6ccfe roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120942025-01-30T20:28:26.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 83df5a27-9cbf-4794-810b-713dfdb6ccfe resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120952025-01-30T20:28:26.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 83df5a27-9cbf-4794-810b-713dfdb6ccfe response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120962025-01-30T20:28:27.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f15ee0a0-ba1e-4709-82a3-08cd7a7ca53e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120972025-01-30T20:28:27.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f15ee0a0-ba1e-4709-82a3-08cd7a7ca53e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120982025-01-30T20:28:27.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f15ee0a0-ba1e-4709-82a3-08cd7a7ca53e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
120992025-01-30T20:28:28.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d9cd7c02-e18b-415f-be2d-1b1806c246f0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
121002025-01-30T20:28:28.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d9cd7c02-e18b-415f-be2d-1b1806c246f0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
121012025-01-30T20:28:28.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d9cd7c02-e18b-415f-be2d-1b1806c246f0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
121022025-01-30T20:28:29.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a21ded4e-2271-46c8-9137-85f222f130a2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
121032025-01-30T20:28:29.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a21ded4e-2271-46c8-9137-85f222f130a2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
121042025-01-30T20:28:29.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a21ded4e-2271-46c8-9137-85f222f130a2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
121052025-01-30T20:28:30.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 12c1bc56-4ca3-4c5d-b6e9-9accbcfc89a3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
121062025-01-30T20:28:30.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 12c1bc56-4ca3-4c5d-b6e9-9accbcfc89a3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
121072025-01-30T20:28:30.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 12c1bc56-4ca3-4c5d-b6e9-9accbcfc89a3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
121082025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
121092025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
121102025-01-30T20:28:30.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
121112025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121122025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121132025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
121142025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
121152025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121162025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
121172025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121182025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
121192025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
121202025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121212025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
121222025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
121232025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
121242025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
121252025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
121262025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
121272025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
121282025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
121292025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
121302025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
121312025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121322025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
121332025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121342025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
121352025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
121362025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
121372025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
121382025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
121392025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
121402025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
121412025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121422025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
121432025-01-30T20:28:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
121442025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
121452025-01-30T20:28:30.802ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:18:30.801764451 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
121462025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
121472025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
121482025-01-30T20:28:30.802ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
121492025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.95\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
121502025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
121512025-01-30T20:28:30.802ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
121522025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
121532025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
121542025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
121552025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
121562025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
121572025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
121582025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121592025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
121602025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
121612025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
121622025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
121632025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
121642025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
121652025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
121662025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
121672025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121682025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
121692025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
121702025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
121712025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121722025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121732025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121742025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
121752025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
121762025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121772025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
121782025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121792025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
121802025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121812025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
121822025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121832025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
121842025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
121852025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121862025-01-30T20:28:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2862, tv_nsec: 12108543 } })
121872025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
121882025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
121892025-01-30T20:28:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2862, tv_nsec: 12129804 } })
121902025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
121912025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
121922025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
121932025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
121942025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
121952025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121962025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121972025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121982025-01-30T20:28:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
121992025-01-30T20:28:30.803ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
122002025-01-30T20:28:30.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.422129ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
122012025-01-30T20:28:30.803ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
122022025-01-30T20:28:30.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.293376ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
122032025-01-30T20:28:30.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
122042025-01-30T20:28:30.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122052025-01-30T20:28:30.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122062025-01-30T20:28:30.804ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.309032ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
122072025-01-30T20:28:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.544769ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
122082025-01-30T20:28:30.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122092025-01-30T20:28:30.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122102025-01-30T20:28:30.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122112025-01-30T20:28:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122122025-01-30T20:28:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
122132025-01-30T20:28:30.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122142025-01-30T20:28:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122152025-01-30T20:28:30.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122162025-01-30T20:28:30.808ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.363395ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
122172025-01-30T20:28:30.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122182025-01-30T20:28:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122192025-01-30T20:28:30.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122202025-01-30T20:28:30.809ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122212025-01-30T20:28:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122222025-01-30T20:28:30.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122232025-01-30T20:28:30.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122242025-01-30T20:28:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
122252025-01-30T20:28:30.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122262025-01-30T20:28:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
122272025-01-30T20:28:30.812ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
122282025-01-30T20:28:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122292025-01-30T20:28:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
122302025-01-30T20:28:30.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2862, tv_nsec: 21979377 } })
122312025-01-30T20:28:30.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
122322025-01-30T20:28:30.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122332025-01-30T20:28:30.814ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122342025-01-30T20:28:30.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
122352025-01-30T20:28:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
122362025-01-30T20:28:30.815ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:18:30.801764451 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
122372025-01-30T20:28:30.815ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.598837ms iteration = 12 status = {"expiration":"2025-01-30T20:18:30.801764451Z","pruned":[]}
122382025-01-30T20:28:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122392025-01-30T20:28:30.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122402025-01-30T20:28:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122412025-01-30T20:28:30.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
122422025-01-30T20:28:30.817ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
122432025-01-30T20:28:30.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
122442025-01-30T20:28:30.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122452025-01-30T20:28:30.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
122462025-01-30T20:28:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122472025-01-30T20:28:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
122482025-01-30T20:28:30.820ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122492025-01-30T20:28:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122502025-01-30T20:28:30.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122512025-01-30T20:28:30.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2862, tv_nsec: 36001866 } })
122522025-01-30T20:28:30.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122532025-01-30T20:28:30.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122542025-01-30T20:28:30.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
122552025-01-30T20:28:30.827ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122562025-01-30T20:28:30.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122572025-01-30T20:28:30.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122582025-01-30T20:28:30.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122592025-01-30T20:28:30.830ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
122602025-01-30T20:28:30.830ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122612025-01-30T20:28:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122622025-01-30T20:28:30.830ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122632025-01-30T20:28:30.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122642025-01-30T20:28:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
122652025-01-30T20:28:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122662025-01-30T20:28:30.832ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2862, tv_nsec: 41936841 } })
122672025-01-30T20:28:30.832ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
122682025-01-30T20:28:30.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122692025-01-30T20:28:30.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122702025-01-30T20:28:30.837ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
122712025-01-30T20:28:30.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
122722025-01-30T20:28:30.842ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122732025-01-30T20:28:30.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122742025-01-30T20:28:30.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122752025-01-30T20:28:30.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122762025-01-30T20:28:30.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122772025-01-30T20:28:30.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122782025-01-30T20:28:30.845ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122792025-01-30T20:28:30.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122802025-01-30T20:28:30.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122812025-01-30T20:28:30.851ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
122822025-01-30T20:28:30.851ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.626837ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
122832025-01-30T20:28:30.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122842025-01-30T20:28:30.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122852025-01-30T20:28:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122862025-01-30T20:28:30.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
122872025-01-30T20:28:30.855ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
122882025-01-30T20:28:30.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
122892025-01-30T20:28:30.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
122902025-01-30T20:28:30.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122912025-01-30T20:28:30.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122922025-01-30T20:28:30.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.360292ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
122932025-01-30T20:28:30.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122942025-01-30T20:28:30.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 59.268105ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
122952025-01-30T20:28:30.860ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
122962025-01-30T20:28:30.860ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 59.221383ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
122972025-01-30T20:28:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
122982025-01-30T20:28:30.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122992025-01-30T20:28:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123002025-01-30T20:28:30.864ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
123012025-01-30T20:28:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123022025-01-30T20:28:30.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123032025-01-30T20:28:30.868ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123042025-01-30T20:28:30.868ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
123052025-01-30T20:28:30.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123062025-01-30T20:28:30.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123072025-01-30T20:28:30.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
123082025-01-30T20:28:30.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
123092025-01-30T20:28:30.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123102025-01-30T20:28:30.871ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
123112025-01-30T20:28:30.871ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
123122025-01-30T20:28:30.871ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.857939ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
123132025-01-30T20:28:30.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
123142025-01-30T20:28:30.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.455223ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
123152025-01-30T20:28:30.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123162025-01-30T20:28:30.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123172025-01-30T20:28:30.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123182025-01-30T20:28:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123192025-01-30T20:28:30.878ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123202025-01-30T20:28:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123212025-01-30T20:28:30.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123222025-01-30T20:28:30.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.109056ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123232025-01-30T20:28:30.881ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
123242025-01-30T20:28:30.881ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
123252025-01-30T20:28:30.881ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
123262025-01-30T20:28:30.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123272025-01-30T20:28:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123282025-01-30T20:28:30.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
123292025-01-30T20:28:30.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123302025-01-30T20:28:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
123312025-01-30T20:28:30.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123322025-01-30T20:28:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123332025-01-30T20:28:30.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.909062ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123342025-01-30T20:28:30.888ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
123352025-01-30T20:28:30.888ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
123362025-01-30T20:28:30.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123372025-01-30T20:28:30.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123382025-01-30T20:28:30.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123392025-01-30T20:28:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
123402025-01-30T20:28:30.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123412025-01-30T20:28:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123422025-01-30T20:28:30.900ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
123432025-01-30T20:28:30.900ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
123442025-01-30T20:28:30.900ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-30 20:18:13.133071 UTC dns_group = external generation = 2
123452025-01-30T20:28:30.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 99.385018ms iteration = 12 status = {"generation":2}
123462025-01-30T20:28:30.901ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
123472025-01-30T20:28:30.901ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
123482025-01-30T20:28:30.901ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 99.520902ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
123492025-01-30T20:28:30.901ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123502025-01-30T20:28:30.901ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
123512025-01-30T20:28:30.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123522025-01-30T20:28:30.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123532025-01-30T20:28:30.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
123542025-01-30T20:28:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
123552025-01-30T20:28:30.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123562025-01-30T20:28:30.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 108.288725ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123572025-01-30T20:28:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
123582025-01-30T20:28:30.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123592025-01-30T20:28:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123602025-01-30T20:28:30.914ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.894664ms iteration = 23 status = 0
123612025-01-30T20:28:30.915ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
123622025-01-30T20:28:30.916ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
123632025-01-30T20:28:30.916ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
123642025-01-30T20:28:30.916ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
123652025-01-30T20:28:30.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123662025-01-30T20:28:30.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123672025-01-30T20:28:30.920ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) }
123682025-01-30T20:28:30.920ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 118.593291ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
123692025-01-30T20:28:30.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123702025-01-30T20:28:30.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
123712025-01-30T20:28:30.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123722025-01-30T20:28:30.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123732025-01-30T20:28:30.939ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123742025-01-30T20:28:30.939ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
123752025-01-30T20:28:30.939ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 137.579838ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
123762025-01-30T20:28:30.948ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
123772025-01-30T20:28:30.948ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 146.801205ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
123782025-01-30T20:28:30.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123792025-01-30T20:28:30.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123802025-01-30T20:28:30.963ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
123812025-01-30T20:28:30.963ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
123822025-01-30T20:28:30.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123832025-01-30T20:28:30.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123842025-01-30T20:28:30.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123852025-01-30T20:28:30.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
123862025-01-30T20:28:30.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123872025-01-30T20:28:30.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123882025-01-30T20:28:30.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123892025-01-30T20:28:30.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123902025-01-30T20:28:30.968ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.20197ms iteration = 26 status = {"physical_disks_added":0}
123912025-01-30T20:28:30.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123922025-01-30T20:28:30.970ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
123932025-01-30T20:28:30.970ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
123942025-01-30T20:28:30.970ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-30 20:18:12.536035 UTC dns_group = internal generation = 1
123952025-01-30T20:28:30.970ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 168.62947ms iteration = 12 status = {"generation":1}
123962025-01-30T20:28:30.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
123972025-01-30T20:28:30.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123982025-01-30T20:28:30.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123992025-01-30T20:28:30.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124002025-01-30T20:28:30.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124012025-01-30T20:28:30.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124022025-01-30T20:28:30.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124032025-01-30T20:28:31.022ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
124042025-01-30T20:28:31.137ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
124052025-01-30T20:28:31.137ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ec258040-6994-406a-aab7-b76a0c4bcd3e", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124062025-01-30T20:28:31.137ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124072025-01-30T20:28:31.139ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4ed627bf-9ccd-49ae-982c-662a8a208128", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124082025-01-30T20:28:31.139ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124092025-01-30T20:28:31.141ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
124102025-01-30T20:28:31.141ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 339.735179ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
124112025-01-30T20:28:31.163ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
124122025-01-30T20:28:31.163ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9882cae6-df70-4d7c-acb7-5dcc76dff30d", "content-length": "691", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} })
124132025-01-30T20:28:31.163ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
124142025-01-30T20:28:31.163ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
124152025-01-30T20:28:31.163ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
124162025-01-30T20:28:31.166ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 364.816515ms iteration = 23 status = {}
124172025-01-30T20:28:31.184ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
124182025-01-30T20:28:31.184ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124192025-01-30T20:28:31.185ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1d9d921-8bd9-4792-ac68-109de08ab2e6", "content-length": "26", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} })
124202025-01-30T20:28:31.185ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124212025-01-30T20:28:31.187ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
124222025-01-30T20:28:31.192ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
124232025-01-30T20:28:31.192ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124242025-01-30T20:28:31.193ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae9f9c50-8346-4416-a89f-a0c0236c912f", "content-length": "26", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} })
124252025-01-30T20:28:31.193ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124262025-01-30T20:28:31.194ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
124272025-01-30T20:28:31.217ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
124282025-01-30T20:28:31.217ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124292025-01-30T20:28:31.218ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f390366f-6c06-4646-b8da-6732de6b0c5e", "content-length": "26", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} })
124302025-01-30T20:28:31.218ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124312025-01-30T20:28:31.220ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
124322025-01-30T20:28:31.243ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
124332025-01-30T20:28:31.243ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124342025-01-30T20:28:31.244ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1ea6f97-e31b-4e6a-9998-25d07105e4d8", "content-length": "372", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} })
124352025-01-30T20:28:31.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124362025-01-30T20:28:31.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124372025-01-30T20:28:31.258ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
124382025-01-30T20:28:31.308ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
124392025-01-30T20:28:31.309ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d9c4efb-3eee-4e63-82cf-46f08a0960a3", "content-length": "1", "date": "Thu, 30 Jan 2025 20:28:30 GMT"} })
124402025-01-30T20:28:31.312ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
124412025-01-30T20:28:31.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
124422025-01-30T20:28:31.314ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
124432025-01-30T20:28:31.314ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
124442025-01-30T20:28:31.314ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "83f68e5d-93dd-427d-8663-c2f03235c2ce", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} })
124452025-01-30T20:28:31.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124462025-01-30T20:28:31.314ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 513.215034ms iteration = 23 status = null
124472025-01-30T20:28:31.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124482025-01-30T20:28:31.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124492025-01-30T20:28:31.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124502025-01-30T20:28:31.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124512025-01-30T20:28:31.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124522025-01-30T20:28:31.325ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124532025-01-30T20:28:31.325ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124542025-01-30T20:28:31.325ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c4997d29-bb73-4bb0-bdb8-22585ba0d656", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} })
124552025-01-30T20:28:31.327ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 526.41968ms iteration = 23 status = {}
124562025-01-30T20:28:31.328ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 526.643387ms iteration = 23 status = {}
124572025-01-30T20:28:31.344ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
124582025-01-30T20:28:31.345ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7485bc2b-5bf4-4950-ae0b-46bdc4e42b66", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124592025-01-30T20:28:31.345ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124602025-01-30T20:28:31.347ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e3f58c2a-6662-437a-8774-2083c283de9c", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124612025-01-30T20:28:31.347ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124622025-01-30T20:28:31.349ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8d17276e-794c-49b2-932f-0f25bd844ef8", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124632025-01-30T20:28:31.349ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124642025-01-30T20:28:31.351ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
124652025-01-30T20:28:31.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 550.108548ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
124662025-01-30T20:28:31.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124672025-01-30T20:28:31.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124682025-01-30T20:28:31.400ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
124692025-01-30T20:28:31.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124702025-01-30T20:28:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124712025-01-30T20:28:31.409ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
124722025-01-30T20:28:31.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9809a296-7217-4e38-b576-f186b0b58a26", "content-length": "134", "date": "Thu, 30 Jan 2025 20:28:30 GMT"} })
124732025-01-30T20:28:31.409ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
124742025-01-30T20:28:31.409ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
124752025-01-30T20:28:31.410ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
124762025-01-30T20:28:31.410ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
124772025-01-30T20:28:31.410ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124782025-01-30T20:28:31.410ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124792025-01-30T20:28:31.410ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124802025-01-30T20:28:31.410ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124812025-01-30T20:28:31.410ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124822025-01-30T20:28:31.410ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124832025-01-30T20:28:31.410ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
124842025-01-30T20:28:31.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124852025-01-30T20:28:31.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124862025-01-30T20:28:31.413ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
124872025-01-30T20:28:31.413ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c204b9a-402b-4408-bc50-db7f68810283", "content-length": "2", "date": "Thu, 30 Jan 2025 20:28:30 GMT"} })
124882025-01-30T20:28:31.413ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
124892025-01-30T20:28:31.413ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "295bd84f-5d8e-43eb-b4a8-3bc7959520b3", "content-length": "52", "date": "Thu, 30 Jan 2025 20:28:30 GMT"} })
124902025-01-30T20:28:31.413ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
124912025-01-30T20:28:31.413ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
124922025-01-30T20:28:31.524ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2ab6e351-f914-4ecb-a6cd-71021699638c", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} })
124932025-01-30T20:28:31.524ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
124942025-01-30T20:28:31.524ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
124952025-01-30T20:28:31.525ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "02916e56-5ec3-4663-9109-f24ef6812423", "content-length": "682", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} })
124962025-01-30T20:28:31.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124972025-01-30T20:28:31.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124982025-01-30T20:28:31.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124992025-01-30T20:28:31.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125002025-01-30T20:28:31.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125012025-01-30T20:28:31.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125022025-01-30T20:28:31.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125032025-01-30T20:28:31.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125042025-01-30T20:28:31.540ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 739.194876ms iteration = 23 status = {}
125052025-01-30T20:28:31.614ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
125062025-01-30T20:28:31.614ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
125072025-01-30T20:28:31.645ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
125082025-01-30T20:28:31.645ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:34175
125092025-01-30T20:28:31.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:34175 req_id = 9c7d3570-6ae0-4fc7-9fd7-1afba22adeef roles = RoleSet { roles: {} } uri = /metrics/producers
125102025-01-30T20:28:31.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:34175 req_id = 9c7d3570-6ae0-4fc7-9fd7-1afba22adeef resource = Database result = Ok(()) uri = /metrics/producers
125112025-01-30T20:28:31.681ZINFOnexus: assigned collector to new producer collector_id = 623434f7-1950-4ff8-a21d-872e401e4248 file = nexus/src/app/oximeter.rs:76 producer_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
125122025-01-30T20:28:31.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36181 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:34175 req_id = 9c7d3570-6ae0-4fc7-9fd7-1afba22adeef response_code = 201 uri = /metrics/producers
125132025-01-30T20:28:31.681ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9c7d3570-6ae0-4fc7-9fd7-1afba22adeef", "content-length": "41", "date": "Thu, 30 Jan 2025 20:28:31 GMT"} })
125142025-01-30T20:28:31.683ZDEBGnexus (producer-registration-task): registered with nexus successfully
125152025-01-30T20:28:31.683ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
125162025-01-30T20:28:31.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f5200c2-4ede-44c4-a868-21c8dce7dcf2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125172025-01-30T20:28:31.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f5200c2-4ede-44c4-a868-21c8dce7dcf2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125182025-01-30T20:28:31.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f5200c2-4ede-44c4-a868-21c8dce7dcf2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125192025-01-30T20:28:31.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = feec9f53-b9cb-4799-9ad9-2d38c50030f1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
125202025-01-30T20:28:31.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = feec9f53-b9cb-4799-9ad9-2d38c50030f1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
125212025-01-30T20:28:31.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = feec9f53-b9cb-4799-9ad9-2d38c50030f1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
125222025-01-30T20:28:32.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 4c7502a7-9206-4ac0-a6ac-d9dc7d754708 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
125232025-01-30T20:28:32.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3e6407c3-67b2-403c-934d-cc4b74245946 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125242025-01-30T20:28:32.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3e6407c3-67b2-403c-934d-cc4b74245946 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125252025-01-30T20:28:32.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3e6407c3-67b2-403c-934d-cc4b74245946 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125262025-01-30T20:28:33.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e9731a21-bcc7-43e6-a924-c319cc5f4670 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125272025-01-30T20:28:33.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e9731a21-bcc7-43e6-a924-c319cc5f4670 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125282025-01-30T20:28:33.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e9731a21-bcc7-43e6-a924-c319cc5f4670 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125292025-01-30T20:28:34.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2349f736-caf5-4cb8-b7da-f7c0a22d456e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125302025-01-30T20:28:34.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2349f736-caf5-4cb8-b7da-f7c0a22d456e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125312025-01-30T20:28:34.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2349f736-caf5-4cb8-b7da-f7c0a22d456e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125322025-01-30T20:28:35.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9baa2303-541a-41ea-957b-1fbeb3142bf6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125332025-01-30T20:28:35.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9baa2303-541a-41ea-957b-1fbeb3142bf6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125342025-01-30T20:28:35.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9baa2303-541a-41ea-957b-1fbeb3142bf6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125352025-01-30T20:28:36.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f7e1b3db-f5a1-44bd-91bc-d0a8f28bdafc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125362025-01-30T20:28:36.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f7e1b3db-f5a1-44bd-91bc-d0a8f28bdafc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125372025-01-30T20:28:36.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f7e1b3db-f5a1-44bd-91bc-d0a8f28bdafc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125382025-01-30T20:28:37.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7ae19c53-3bf8-40c6-ace9-81eab61237b4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125392025-01-30T20:28:37.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7ae19c53-3bf8-40c6-ace9-81eab61237b4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125402025-01-30T20:28:37.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7ae19c53-3bf8-40c6-ace9-81eab61237b4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125412025-01-30T20:28:38.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a58bc2e4-a18e-4130-8e1a-fddac1f99888 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125422025-01-30T20:28:38.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a58bc2e4-a18e-4130-8e1a-fddac1f99888 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125432025-01-30T20:28:38.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a58bc2e4-a18e-4130-8e1a-fddac1f99888 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125442025-01-30T20:28:39.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dfe57a56-594b-4186-bd8f-096d7bc4e953 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125452025-01-30T20:28:39.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dfe57a56-594b-4186-bd8f-096d7bc4e953 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125462025-01-30T20:28:39.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dfe57a56-594b-4186-bd8f-096d7bc4e953 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125472025-01-30T20:28:40.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
125482025-01-30T20:28:40.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
125492025-01-30T20:28:40.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125502025-01-30T20:28:40.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125512025-01-30T20:28:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125522025-01-30T20:28:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125532025-01-30T20:28:40.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125542025-01-30T20:28:40.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125552025-01-30T20:28:40.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125562025-01-30T20:28:40.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.935979ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125572025-01-30T20:28:40.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
125582025-01-30T20:28:40.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125592025-01-30T20:28:40.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125602025-01-30T20:28:40.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125612025-01-30T20:28:40.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125622025-01-30T20:28:40.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125632025-01-30T20:28:40.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
125642025-01-30T20:28:40.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125652025-01-30T20:28:40.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125662025-01-30T20:28:40.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
125672025-01-30T20:28:40.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.948341ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
125682025-01-30T20:28:40.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 86489e73-3b28-4efb-89a8-30e81ad7de81 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125692025-01-30T20:28:40.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 86489e73-3b28-4efb-89a8-30e81ad7de81 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125702025-01-30T20:28:40.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 86489e73-3b28-4efb-89a8-30e81ad7de81 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125712025-01-30T20:28:41.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b72cb696-4808-4da0-b2d2-a072950386fd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125722025-01-30T20:28:41.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b72cb696-4808-4da0-b2d2-a072950386fd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125732025-01-30T20:28:41.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b72cb696-4808-4da0-b2d2-a072950386fd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125742025-01-30T20:28:42.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 556 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 9bda6120-9b17-4bf0-9463-ca727245407f response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
125752025-01-30T20:28:43.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = be25f0bb-fc13-48a2-913d-e9c02ec17321 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125762025-01-30T20:28:43.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = be25f0bb-fc13-48a2-913d-e9c02ec17321 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125772025-01-30T20:28:43.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = be25f0bb-fc13-48a2-913d-e9c02ec17321 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125782025-01-30T20:28:44.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = faa9f215-83d9-4c29-871b-33652f508140 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125792025-01-30T20:28:44.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = faa9f215-83d9-4c29-871b-33652f508140 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125802025-01-30T20:28:44.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = faa9f215-83d9-4c29-871b-33652f508140 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125812025-01-30T20:28:45.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a977305c-4d19-4a62-aa96-f91f1e4c9f67 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125822025-01-30T20:28:45.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a977305c-4d19-4a62-aa96-f91f1e4c9f67 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125832025-01-30T20:28:45.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a977305c-4d19-4a62-aa96-f91f1e4c9f67 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125842025-01-30T20:28:46.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 84ac4957-67b5-4267-9f66-df21365afd0a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125852025-01-30T20:28:46.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 84ac4957-67b5-4267-9f66-df21365afd0a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125862025-01-30T20:28:46.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 84ac4957-67b5-4267-9f66-df21365afd0a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125872025-01-30T20:28:47.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4e079f0b-ab97-4cf0-bdea-bcaa224cac87 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125882025-01-30T20:28:47.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4e079f0b-ab97-4cf0-bdea-bcaa224cac87 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125892025-01-30T20:28:47.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4e079f0b-ab97-4cf0-bdea-bcaa224cac87 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125902025-01-30T20:28:48.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bfeed372-7e9b-43ad-bf34-8d2db2388f7e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125912025-01-30T20:28:48.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bfeed372-7e9b-43ad-bf34-8d2db2388f7e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125922025-01-30T20:28:48.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = bfeed372-7e9b-43ad-bf34-8d2db2388f7e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125932025-01-30T20:28:49.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f3f9e43e-ec9f-4f0b-b3cb-803b2631064b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125942025-01-30T20:28:49.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f3f9e43e-ec9f-4f0b-b3cb-803b2631064b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125952025-01-30T20:28:49.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f3f9e43e-ec9f-4f0b-b3cb-803b2631064b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125962025-01-30T20:28:50.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 06bd59ce-9b88-4b96-ae3b-7d8d55d07b6e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125972025-01-30T20:28:50.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 06bd59ce-9b88-4b96-ae3b-7d8d55d07b6e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125982025-01-30T20:28:50.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 06bd59ce-9b88-4b96-ae3b-7d8d55d07b6e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
125992025-01-30T20:28:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
126002025-01-30T20:28:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
126012025-01-30T20:28:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126022025-01-30T20:28:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126032025-01-30T20:28:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126042025-01-30T20:28:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126052025-01-30T20:28:50.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126062025-01-30T20:28:50.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126072025-01-30T20:28:50.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126082025-01-30T20:28:50.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.023022ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
126092025-01-30T20:28:50.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126102025-01-30T20:28:50.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126112025-01-30T20:28:50.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126122025-01-30T20:28:50.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126132025-01-30T20:28:50.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126142025-01-30T20:28:50.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126152025-01-30T20:28:50.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
126162025-01-30T20:28:50.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126172025-01-30T20:28:50.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126182025-01-30T20:28:50.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
126192025-01-30T20:28:50.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.67321ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
126202025-01-30T20:28:51.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b9fe07e9-66d3-46b8-91be-e94ef7c3b218 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126212025-01-30T20:28:51.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b9fe07e9-66d3-46b8-91be-e94ef7c3b218 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126222025-01-30T20:28:51.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b9fe07e9-66d3-46b8-91be-e94ef7c3b218 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126232025-01-30T20:28:52.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6e5096e5-e832-4f99-a8c3-a13841757c72 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126242025-01-30T20:28:52.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6e5096e5-e832-4f99-a8c3-a13841757c72 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126252025-01-30T20:28:52.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6e5096e5-e832-4f99-a8c3-a13841757c72 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126262025-01-30T20:28:52.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 492 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = a898bab0-5b87-44f8-a71b-f88d31892a76 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
126272025-01-30T20:28:53.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c769e7e9-8650-43f8-837a-ee84c6145fe1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126282025-01-30T20:28:53.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c769e7e9-8650-43f8-837a-ee84c6145fe1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126292025-01-30T20:28:53.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c769e7e9-8650-43f8-837a-ee84c6145fe1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126302025-01-30T20:28:54.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b5133818-18c2-4804-9022-e71155d8a3cd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126312025-01-30T20:28:54.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b5133818-18c2-4804-9022-e71155d8a3cd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126322025-01-30T20:28:54.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b5133818-18c2-4804-9022-e71155d8a3cd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126332025-01-30T20:28:55.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ed4cb302-d242-40b2-9bc1-288b54d79e08 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126342025-01-30T20:28:55.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ed4cb302-d242-40b2-9bc1-288b54d79e08 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126352025-01-30T20:28:55.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ed4cb302-d242-40b2-9bc1-288b54d79e08 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126362025-01-30T20:28:56.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 25ee5147-22a1-4edd-ae30-327d9028c7b4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126372025-01-30T20:28:56.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 25ee5147-22a1-4edd-ae30-327d9028c7b4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126382025-01-30T20:28:56.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 25ee5147-22a1-4edd-ae30-327d9028c7b4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126392025-01-30T20:28:57.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b0a768e4-f62a-439d-beb2-33b36b8ea7a7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126402025-01-30T20:28:57.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b0a768e4-f62a-439d-beb2-33b36b8ea7a7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126412025-01-30T20:28:57.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b0a768e4-f62a-439d-beb2-33b36b8ea7a7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126422025-01-30T20:28:58.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5531e9f1-3b6e-4174-b32e-26b813dab061 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126432025-01-30T20:28:58.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5531e9f1-3b6e-4174-b32e-26b813dab061 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126442025-01-30T20:28:58.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5531e9f1-3b6e-4174-b32e-26b813dab061 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126452025-01-30T20:28:59.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a4fa0db-7b94-4226-a3b9-6de48c95f187 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126462025-01-30T20:28:59.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a4fa0db-7b94-4226-a3b9-6de48c95f187 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126472025-01-30T20:28:59.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a4fa0db-7b94-4226-a3b9-6de48c95f187 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126482025-01-30T20:29:00.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e05b35c8-c29d-4454-add9-7ba4bcfb021a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126492025-01-30T20:29:00.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e05b35c8-c29d-4454-add9-7ba4bcfb021a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126502025-01-30T20:29:00.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e05b35c8-c29d-4454-add9-7ba4bcfb021a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
126512025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
126522025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
126532025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
126542025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
126552025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
126562025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
126572025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
126582025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
126592025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
126602025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
126612025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
126622025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
126632025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126642025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
126652025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
126662025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
126672025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
126682025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
126692025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126702025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
126712025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
126722025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
126732025-01-30T20:29:00.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
126742025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
126752025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126762025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126772025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
126782025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
126792025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
126802025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
126812025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
126822025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
126832025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
126842025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
126852025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
126862025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126872025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
126882025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
126892025-01-30T20:29:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
126902025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
126912025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126922025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
126932025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
126942025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126952025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
126962025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126972025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
126982025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126992025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
127002025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127012025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127022025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
127032025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127042025-01-30T20:29:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127052025-01-30T20:29:00.803ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127062025-01-30T20:29:00.804ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.032154ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
127072025-01-30T20:29:00.804ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2892, tv_nsec: 14368356 } })
127082025-01-30T20:29:00.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
127092025-01-30T20:29:00.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
127102025-01-30T20:29:00.805ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
127112025-01-30T20:29:00.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
127122025-01-30T20:29:00.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
127132025-01-30T20:29:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
127142025-01-30T20:29:00.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127152025-01-30T20:29:00.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127162025-01-30T20:29:00.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127172025-01-30T20:29:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127182025-01-30T20:29:00.808ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127192025-01-30T20:29:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127202025-01-30T20:29:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
127212025-01-30T20:29:00.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127222025-01-30T20:29:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127232025-01-30T20:29:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
127242025-01-30T20:29:00.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127252025-01-30T20:29:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127262025-01-30T20:29:00.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127272025-01-30T20:29:00.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2892, tv_nsec: 21841953 } })
127282025-01-30T20:29:00.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
127292025-01-30T20:29:00.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127302025-01-30T20:29:00.813ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127312025-01-30T20:29:00.813ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
127322025-01-30T20:29:00.813ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127332025-01-30T20:29:00.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127342025-01-30T20:29:00.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127352025-01-30T20:29:00.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127362025-01-30T20:29:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127372025-01-30T20:29:00.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127382025-01-30T20:29:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127392025-01-30T20:29:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
127402025-01-30T20:29:00.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127412025-01-30T20:29:00.815ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127422025-01-30T20:29:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127432025-01-30T20:29:00.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127442025-01-30T20:29:00.816ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
127452025-01-30T20:29:00.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
127462025-01-30T20:29:00.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
127472025-01-30T20:29:00.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
127482025-01-30T20:29:00.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127492025-01-30T20:29:00.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127502025-01-30T20:29:00.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127512025-01-30T20:29:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127522025-01-30T20:29:00.826ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127532025-01-30T20:29:00.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127542025-01-30T20:29:00.827ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127552025-01-30T20:29:00.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127562025-01-30T20:29:00.829ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2892, tv_nsec: 38875026 } })
127572025-01-30T20:29:00.829ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
127582025-01-30T20:29:00.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127592025-01-30T20:29:00.830ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127602025-01-30T20:29:00.830ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
127612025-01-30T20:29:00.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127622025-01-30T20:29:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127632025-01-30T20:29:00.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127642025-01-30T20:29:00.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127652025-01-30T20:29:00.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127662025-01-30T20:29:00.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127672025-01-30T20:29:00.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127682025-01-30T20:29:00.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127692025-01-30T20:29:00.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127702025-01-30T20:29:00.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127712025-01-30T20:29:00.836ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
127722025-01-30T20:29:00.836ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 34.386645ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
127732025-01-30T20:29:00.836ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127742025-01-30T20:29:00.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
127752025-01-30T20:29:00.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127762025-01-30T20:29:00.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127772025-01-30T20:29:00.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127782025-01-30T20:29:00.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127792025-01-30T20:29:00.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
127802025-01-30T20:29:00.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127812025-01-30T20:29:00.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127822025-01-30T20:29:00.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.616502ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
127832025-01-30T20:29:00.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127842025-01-30T20:29:00.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
127852025-01-30T20:29:00.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127862025-01-30T20:29:00.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127872025-01-30T20:29:00.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127882025-01-30T20:29:00.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
127892025-01-30T20:29:00.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127902025-01-30T20:29:00.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127912025-01-30T20:29:00.848ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 47.039805ms iteration = 27 status = {"physical_disks_added":0}
127922025-01-30T20:29:00.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127932025-01-30T20:29:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
127942025-01-30T20:29:00.851ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
127952025-01-30T20:29:00.851ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.70985ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
127962025-01-30T20:29:00.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.916739ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
127972025-01-30T20:29:00.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127982025-01-30T20:29:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127992025-01-30T20:29:00.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 56.358685ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
128002025-01-30T20:29:00.863ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128012025-01-30T20:29:00.863ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
128022025-01-30T20:29:00.863ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 61.793495ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
128032025-01-30T20:29:00.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 61.898448ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
128042025-01-30T20:29:00.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.474334ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
128052025-01-30T20:29:00.864ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128062025-01-30T20:29:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
128072025-01-30T20:29:00.866ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
128082025-01-30T20:29:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
128092025-01-30T20:29:00.886ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
128102025-01-30T20:29:00.886ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128112025-01-30T20:29:00.886ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f48444c7-903e-4671-82b3-ed2249fff2bc", "content-length": "26", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128122025-01-30T20:29:00.886ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128132025-01-30T20:29:00.889ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
128142025-01-30T20:29:00.917ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
128152025-01-30T20:29:00.917ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128162025-01-30T20:29:00.917ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f369d608-3082-49a6-b4ab-6fa9cf4d1f30", "content-length": "26", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128172025-01-30T20:29:00.917ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128182025-01-30T20:29:00.919ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
128192025-01-30T20:29:00.942ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
128202025-01-30T20:29:00.942ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128212025-01-30T20:29:00.942ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9286a816-047f-416f-a926-8bc32cb9993d", "content-length": "26", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128222025-01-30T20:29:00.942ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128232025-01-30T20:29:00.943ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
128242025-01-30T20:29:00.954ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
128252025-01-30T20:29:00.954ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128262025-01-30T20:29:00.954ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc5b4f92-194c-47c6-b19e-da0ded551ea0", "content-length": "372", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128272025-01-30T20:29:00.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128282025-01-30T20:29:00.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128292025-01-30T20:29:00.956ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 154.734175ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
128302025-01-30T20:29:00.957ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128312025-01-30T20:29:00.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128322025-01-30T20:29:00.958ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128332025-01-30T20:29:00.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
128342025-01-30T20:29:00.961ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128352025-01-30T20:29:00.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128362025-01-30T20:29:00.993ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
128372025-01-30T20:29:00.993ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 192.339018ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
128382025-01-30T20:29:01.004ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
128392025-01-30T20:29:01.005ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0af4d29b-fc89-4248-8228-23e1618da32c", "content-length": "1", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128402025-01-30T20:29:01.005ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
128412025-01-30T20:29:01.005ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
128422025-01-30T20:29:01.005ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5c71e4ad-8341-4806-bec9-aa5b84e1405b", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128432025-01-30T20:29:01.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128442025-01-30T20:29:01.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128452025-01-30T20:29:01.007ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
128462025-01-30T20:29:01.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
128472025-01-30T20:29:01.119ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 318.261583ms iteration = 24 status = {}
128482025-01-30T20:29:01.126ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
128492025-01-30T20:29:01.126ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "709cd14c-ed7b-4840-b7f8-241f4dabe9b2", "content-length": "691", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128502025-01-30T20:29:01.126ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
128512025-01-30T20:29:01.126ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
128522025-01-30T20:29:01.126ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
128532025-01-30T20:29:01.128ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 326.81906ms iteration = 24 status = {}
128542025-01-30T20:29:01.128ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 327.000996ms iteration = 24 status = 0
128552025-01-30T20:29:01.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128562025-01-30T20:29:01.129ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 328.098017ms iteration = 24 status = null
128572025-01-30T20:29:01.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128582025-01-30T20:29:01.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128592025-01-30T20:29:01.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128602025-01-30T20:29:01.138ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
128612025-01-30T20:29:01.138ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128622025-01-30T20:29:01.139ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "69a5696f-c4f9-4eea-bbab-5a40c476197d", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128632025-01-30T20:29:01.141ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 340.172541ms iteration = 24 status = {}
128642025-01-30T20:29:01.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128652025-01-30T20:29:01.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128662025-01-30T20:29:01.194ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
128672025-01-30T20:29:01.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128682025-01-30T20:29:01.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128692025-01-30T20:29:01.204ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
128702025-01-30T20:29:01.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fcdaa9d-1112-4ed1-b2fc-5c586529d708", "content-length": "134", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128712025-01-30T20:29:01.205ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
128722025-01-30T20:29:01.205ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
128732025-01-30T20:29:01.205ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
128742025-01-30T20:29:01.205ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
128752025-01-30T20:29:01.205ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128762025-01-30T20:29:01.205ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128772025-01-30T20:29:01.205ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128782025-01-30T20:29:01.205ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
128792025-01-30T20:29:01.205ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128802025-01-30T20:29:01.205ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
128812025-01-30T20:29:01.205ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
128822025-01-30T20:29:01.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128832025-01-30T20:29:01.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128842025-01-30T20:29:01.208ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
128852025-01-30T20:29:01.208ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cc6b4f6-c4e3-4eae-a2a1-74e592e1cdd9", "content-length": "2", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128862025-01-30T20:29:01.208ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
128872025-01-30T20:29:01.208ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "74a28849-19f1-438d-a645-9124917c907b", "content-length": "52", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128882025-01-30T20:29:01.208ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
128892025-01-30T20:29:01.208ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
128902025-01-30T20:29:01.349ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "05993e39-9d20-4990-b450-7f5bbda6d644", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128912025-01-30T20:29:01.349ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
128922025-01-30T20:29:01.349ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
128932025-01-30T20:29:01.350ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fdfd100-7632-42db-ae40-c6fc277e0188", "content-length": "682", "date": "Thu, 30 Jan 2025 20:29:00 GMT"} })
128942025-01-30T20:29:01.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128952025-01-30T20:29:01.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128962025-01-30T20:29:01.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128972025-01-30T20:29:01.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128982025-01-30T20:29:01.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128992025-01-30T20:29:01.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129002025-01-30T20:29:01.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129012025-01-30T20:29:01.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129022025-01-30T20:29:01.370ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 569.312611ms iteration = 24 status = {}
129032025-01-30T20:29:01.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b6a6e7ef-0094-43e7-b028-83892168fa56 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129042025-01-30T20:29:01.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b6a6e7ef-0094-43e7-b028-83892168fa56 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129052025-01-30T20:29:01.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b6a6e7ef-0094-43e7-b028-83892168fa56 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129062025-01-30T20:29:01.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 9ce179c4-776d-4976-ac51-4ac026f9b807 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
129072025-01-30T20:29:01.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 9ce179c4-776d-4976-ac51-4ac026f9b807 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
129082025-01-30T20:29:01.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 9ce179c4-776d-4976-ac51-4ac026f9b807 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
129092025-01-30T20:29:02.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 525 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = bd034ab1-340c-4841-b549-15a026c6aba3 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
129102025-01-30T20:29:02.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f68950bb-a4d0-4f80-bb49-fc892bf6cf2d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129112025-01-30T20:29:02.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f68950bb-a4d0-4f80-bb49-fc892bf6cf2d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129122025-01-30T20:29:02.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f68950bb-a4d0-4f80-bb49-fc892bf6cf2d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129132025-01-30T20:29:02.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 16dd3af9-b6e4-4762-addf-05bbce5fae82 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
129142025-01-30T20:29:02.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 16dd3af9-b6e4-4762-addf-05bbce5fae82 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
129152025-01-30T20:29:02.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 16dd3af9-b6e4-4762-addf-05bbce5fae82 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
129162025-01-30T20:29:02.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 0482e286-0d6c-4066-b6d3-773f3376671f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
129172025-01-30T20:29:02.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 0482e286-0d6c-4066-b6d3-773f3376671f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
129182025-01-30T20:29:02.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 0482e286-0d6c-4066-b6d3-773f3376671f response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
129192025-01-30T20:29:03.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5f74f8b8-9a1d-4204-9831-e0f68b5da9d1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129202025-01-30T20:29:03.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5f74f8b8-9a1d-4204-9831-e0f68b5da9d1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129212025-01-30T20:29:03.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5f74f8b8-9a1d-4204-9831-e0f68b5da9d1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129222025-01-30T20:29:04.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c98e0929-4237-412d-800f-fee3c6dc3097 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129232025-01-30T20:29:04.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c98e0929-4237-412d-800f-fee3c6dc3097 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129242025-01-30T20:29:04.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c98e0929-4237-412d-800f-fee3c6dc3097 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129252025-01-30T20:29:05.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 27fc4b16-1760-4c15-9c8c-0243791c994a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129262025-01-30T20:29:05.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 27fc4b16-1760-4c15-9c8c-0243791c994a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129272025-01-30T20:29:05.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 27fc4b16-1760-4c15-9c8c-0243791c994a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129282025-01-30T20:29:06.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9fc23037-096f-4225-b344-4a0986f9ece4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129292025-01-30T20:29:06.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9fc23037-096f-4225-b344-4a0986f9ece4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129302025-01-30T20:29:06.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9fc23037-096f-4225-b344-4a0986f9ece4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129312025-01-30T20:29:07.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7baf2f39-464a-4f0d-b473-f0d3dcbb2a15 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129322025-01-30T20:29:07.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7baf2f39-464a-4f0d-b473-f0d3dcbb2a15 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129332025-01-30T20:29:07.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7baf2f39-464a-4f0d-b473-f0d3dcbb2a15 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129342025-01-30T20:29:08.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 180258a3-a0ff-4fbd-ae1e-10bfc573be8a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129352025-01-30T20:29:08.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 180258a3-a0ff-4fbd-ae1e-10bfc573be8a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129362025-01-30T20:29:08.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 180258a3-a0ff-4fbd-ae1e-10bfc573be8a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129372025-01-30T20:29:09.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9f299af9-a0dd-4c15-871f-001069a08eea roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129382025-01-30T20:29:09.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9f299af9-a0dd-4c15-871f-001069a08eea resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129392025-01-30T20:29:09.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9f299af9-a0dd-4c15-871f-001069a08eea response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129402025-01-30T20:29:09.836ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 611a6a2d-7aee-4e62-a825-6a92bb922e26 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-30T20:29:09.819752076Z }
129412025-01-30T20:29:09.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 611a6a2d-7aee-4e62-a825-6a92bb922e26 roles = RoleSet { roles: {} } uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
129422025-01-30T20:29:09.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 611a6a2d-7aee-4e62-a825-6a92bb922e26 resource = Database result = Ok(()) uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
129432025-01-30T20:29:09.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43305 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 611a6a2d-7aee-4e62-a825-6a92bb922e26 response_code = 204 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
129442025-01-30T20:29:09.863ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ce9d2562-b5cd-4fac-8bb9-7c6e43e803e9 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-30T20:29:09.863754477Z }
129452025-01-30T20:29:09.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ce9d2562-b5cd-4fac-8bb9-7c6e43e803e9 roles = RoleSet { roles: {} } uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
129462025-01-30T20:29:09.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ce9d2562-b5cd-4fac-8bb9-7c6e43e803e9 resource = Database result = Ok(()) uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
129472025-01-30T20:29:09.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36383 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ce9d2562-b5cd-4fac-8bb9-7c6e43e803e9 response_code = 204 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
129482025-01-30T20:29:10.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f6866d7-ac21-4a28-be05-8ce825d7efa6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129492025-01-30T20:29:10.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f6866d7-ac21-4a28-be05-8ce825d7efa6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129502025-01-30T20:29:10.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f6866d7-ac21-4a28-be05-8ce825d7efa6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129512025-01-30T20:29:10.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
129522025-01-30T20:29:10.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129532025-01-30T20:29:10.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
129542025-01-30T20:29:10.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129552025-01-30T20:29:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129562025-01-30T20:29:10.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129572025-01-30T20:29:10.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129582025-01-30T20:29:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
129592025-01-30T20:29:10.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129602025-01-30T20:29:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129612025-01-30T20:29:10.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129622025-01-30T20:29:10.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129632025-01-30T20:29:10.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129642025-01-30T20:29:10.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
129652025-01-30T20:29:10.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129662025-01-30T20:29:10.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129672025-01-30T20:29:10.826ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
129682025-01-30T20:29:10.826ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.186309ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
129692025-01-30T20:29:10.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129702025-01-30T20:29:10.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129712025-01-30T20:29:10.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.954323ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
129722025-01-30T20:29:11.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e4e29cd7-2811-4f28-a8e8-7ec8b9a0bb8e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129732025-01-30T20:29:11.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e4e29cd7-2811-4f28-a8e8-7ec8b9a0bb8e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129742025-01-30T20:29:11.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e4e29cd7-2811-4f28-a8e8-7ec8b9a0bb8e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129752025-01-30T20:29:12.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 602 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = fb76abc5-120a-49b0-a434-ed086cb6ae16 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
129762025-01-30T20:29:12.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1a89d0de-d39c-4c5d-8a9f-dd253b290531 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129772025-01-30T20:29:12.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1a89d0de-d39c-4c5d-8a9f-dd253b290531 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129782025-01-30T20:29:12.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1a89d0de-d39c-4c5d-8a9f-dd253b290531 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129792025-01-30T20:29:13.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b50f11ca-d3c0-4659-b791-473e40ad9564 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129802025-01-30T20:29:13.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b50f11ca-d3c0-4659-b791-473e40ad9564 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129812025-01-30T20:29:13.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b50f11ca-d3c0-4659-b791-473e40ad9564 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129822025-01-30T20:29:14.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a811c214-78ea-4e6c-973b-92c7a77ad1e8 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129832025-01-30T20:29:14.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a811c214-78ea-4e6c-973b-92c7a77ad1e8 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129842025-01-30T20:29:14.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a811c214-78ea-4e6c-973b-92c7a77ad1e8 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129852025-01-30T20:29:15.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9f8cca42-4ec1-43de-badb-3814d93972c0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129862025-01-30T20:29:15.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9f8cca42-4ec1-43de-badb-3814d93972c0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129872025-01-30T20:29:15.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9f8cca42-4ec1-43de-badb-3814d93972c0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129882025-01-30T20:29:16.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c22ff612-0317-4e8a-abe8-0b46c9d7f8b5 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129892025-01-30T20:29:16.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c22ff612-0317-4e8a-abe8-0b46c9d7f8b5 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129902025-01-30T20:29:16.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c22ff612-0317-4e8a-abe8-0b46c9d7f8b5 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129912025-01-30T20:29:17.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6f63e001-83ac-46bc-807f-c096036696e1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129922025-01-30T20:29:17.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6f63e001-83ac-46bc-807f-c096036696e1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129932025-01-30T20:29:17.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6f63e001-83ac-46bc-807f-c096036696e1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129942025-01-30T20:29:18.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 36434d86-db4f-4d57-bbfb-02c7d55730fc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129952025-01-30T20:29:18.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 36434d86-db4f-4d57-bbfb-02c7d55730fc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129962025-01-30T20:29:18.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 36434d86-db4f-4d57-bbfb-02c7d55730fc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129972025-01-30T20:29:19.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9c8c489a-8afc-4080-98ca-707aa1bfc978 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129982025-01-30T20:29:19.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9c8c489a-8afc-4080-98ca-707aa1bfc978 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
129992025-01-30T20:29:19.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9c8c489a-8afc-4080-98ca-707aa1bfc978 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
130002025-01-30T20:29:20.057ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d91c3556-f841-4409-a5f5-92e0f5c5b856 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-30T20:29:20.057509765Z }
130012025-01-30T20:29:20.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d91c3556-f841-4409-a5f5-92e0f5c5b856 roles = RoleSet { roles: {} } uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130022025-01-30T20:29:20.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d91c3556-f841-4409-a5f5-92e0f5c5b856 resource = Database result = Ok(()) uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130032025-01-30T20:29:20.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41552 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d91c3556-f841-4409-a5f5-92e0f5c5b856 response_code = 204 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130042025-01-30T20:29:20.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
130052025-01-30T20:29:20.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130062025-01-30T20:29:20.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
130072025-01-30T20:29:20.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130082025-01-30T20:29:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130092025-01-30T20:29:20.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130102025-01-30T20:29:20.831ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130112025-01-30T20:29:20.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130122025-01-30T20:29:20.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.562336ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130132025-01-30T20:29:20.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130142025-01-30T20:29:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130152025-01-30T20:29:20.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130162025-01-30T20:29:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130172025-01-30T20:29:20.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130182025-01-30T20:29:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130192025-01-30T20:29:20.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130202025-01-30T20:29:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
130212025-01-30T20:29:20.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130222025-01-30T20:29:20.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130232025-01-30T20:29:20.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
130242025-01-30T20:29:20.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.730868ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
130252025-01-30T20:29:20.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5d3e3414-d0ec-43ce-941a-ccc3cd3d6001 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
130262025-01-30T20:29:20.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5d3e3414-d0ec-43ce-941a-ccc3cd3d6001 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
130272025-01-30T20:29:20.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5d3e3414-d0ec-43ce-941a-ccc3cd3d6001 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
130282025-01-30T20:29:20.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 5a6deb65-3f48-4669-b2a8-96dc8766736e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
130292025-01-30T20:29:20.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 5a6deb65-3f48-4669-b2a8-96dc8766736e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
130302025-01-30T20:29:20.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 5a6deb65-3f48-4669-b2a8-96dc8766736e response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
130312025-01-30T20:29:20.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = ef5d5a71-23e9-4429-ac43-2f88f5e19199 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
130322025-01-30T20:29:20.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = ef5d5a71-23e9-4429-ac43-2f88f5e19199 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
130332025-01-30T20:29:20.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = ef5d5a71-23e9-4429-ac43-2f88f5e19199 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
130342025-01-30T20:29:21.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e340d274-8f9d-41e6-9fb5-2b94e65c4837 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
130352025-01-30T20:29:21.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e340d274-8f9d-41e6-9fb5-2b94e65c4837 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
130362025-01-30T20:29:21.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e340d274-8f9d-41e6-9fb5-2b94e65c4837 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
130372025-01-30T20:29:21.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 459e4f59-2e6b-4d89-a1be-e3e5972593fb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
130382025-01-30T20:29:21.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 459e4f59-2e6b-4d89-a1be-e3e5972593fb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
130392025-01-30T20:29:21.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 459e4f59-2e6b-4d89-a1be-e3e5972593fb response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
130402025-01-30T20:29:22.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 532 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = ff5f57bf-5d9f-4ccc-844a-050a261c8113 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
130412025-01-30T20:29:22.512ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-30T20:29:22.511842292Z }
130422025-01-30T20:29:22.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 roles = RoleSet { roles: {} } uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130432025-01-30T20:29:22.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 resource = Database result = Ok(()) uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130442025-01-30T20:29:22.520ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a vmm_needs_update = true
130452025-01-30T20:29:22.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 roles = RoleSet { roles: {} } uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130462025-01-30T20:29:22.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 resource = Database result = Ok(()) uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130472025-01-30T20:29:22.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 roles = RoleSet { roles: {} } uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130482025-01-30T20:29:22.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 resource = Database result = Ok(()) uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130492025-01-30T20:29:22.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 roles = RoleSet { roles: {} } uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130502025-01-30T20:29:22.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 resource = Database result = Ok(()) uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130512025-01-30T20:29:22.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 roles = RoleSet { roles: {} } uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130522025-01-30T20:29:22.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 resource = Database result = Ok(()) uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130532025-01-30T20:29:22.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 roles = RoleSet { roles: {} } uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130542025-01-30T20:29:22.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 resource = Database result = Ok(()) uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130552025-01-30T20:29:22.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 roles = RoleSet { roles: {} } uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130562025-01-30T20:29:22.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 resource = Database result = Ok(()) uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130572025-01-30T20:29:22.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130582025-01-30T20:29:22.542ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9bc122de-f506-4c6d-8101-a7727b3ad959, lookup_type: ById(9bc122de-f506-4c6d-8101-a7727b3ad959) }, key: 2100efc2-a5bc-433f-9aa4-aee5cc503f4f, lookup_type: ById(2100efc2-a5bc-433f-9aa4-aee5cc503f4f) }, key: d59fcf7d-4765-4f60-8946-4e33b60c5af2, lookup_type: ById(d59fcf7d-4765-4f60-8946-4e33b60c5af2) } result = Ok(()) uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130592025-01-30T20:29:22.558ZINFOnexus (dropshot_internal): starting update saga for d59fcf7d-4765-4f60-8946-4e33b60c5af2 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1545 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-30T20:29:22.511842292Z }
130602025-01-30T20:29:22.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48722 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 response_code = 204 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130612025-01-30T20:29:22.560ZDEBGnexus (dropshot_internal): preparing instance-update saga for d59fcf7d-4765-4f60-8946-4e33b60c5af2... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c71ccbbf-b2f4-489d-8535-d5cc5be1fd07 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130622025-01-30T20:29:22.560ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update
130632025-01-30T20:29:22.561ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a8ffcd79-0ae3-475c-810b-4bf5dcc1c9d6 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-30T20:29:22.511842292Z }
130642025-01-30T20:29:22.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a8ffcd79-0ae3-475c-810b-4bf5dcc1c9d6 roles = RoleSet { roles: {} } uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130652025-01-30T20:29:22.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a8ffcd79-0ae3-475c-810b-4bf5dcc1c9d6 resource = Database result = Ok(()) uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130662025-01-30T20:29:22.565ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"d59fcf7d-4765-4f60-8946-4e33b60c5af2","lookup_type":{"ById":"d59fcf7d-4765-4f60-8946-4e33b60c5af2"},"parent":{"key":"2100efc2-a5bc-433f-9aa4-aee5cc503f4f","lookup_type":{"ById":"2100efc2-a5bc-433f-9aa4-aee5cc503f4f"},"parent":{"key":"9bc122de-f506-4c6d-8101-a7727b3ad959","lookup_type":{"ById":"9bc122de-f506-4c6d-8101-a7727b3ad959"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
130672025-01-30T20:29:22.565ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update
130682025-01-30T20:29:22.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38008 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a8ffcd79-0ae3-475c-810b-4bf5dcc1c9d6 response_code = 204 uri = /vmms/a7d75321-6410-4aa2-8dba-96cd43cec01a
130692025-01-30T20:29:22.606ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update
130702025-01-30T20:29:22.606ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
130712025-01-30T20:29:22.606ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
130722025-01-30T20:29:22.606ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 57925e49-8990-4ce2-8703-242158ae3405
130732025-01-30T20:29:22.612ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
130742025-01-30T20:29:22.612ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 57925e49-8990-4ce2-8703-242158ae3405
130752025-01-30T20:29:22.618ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
130762025-01-30T20:29:22.618ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 57925e49-8990-4ce2-8703-242158ae3405
130772025-01-30T20:29:22.621ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
130782025-01-30T20:29:22.621ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("602ecade-933f-4a10-abfa-030976db8d89")) node_id = 0 saga_id = 57925e49-8990-4ce2-8703-242158ae3405
130792025-01-30T20:29:22.625ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
130802025-01-30T20:29:22.625ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 57925e49-8990-4ce2-8703-242158ae3405
130812025-01-30T20:29:22.637ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update
130822025-01-30T20:29:22.637ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130832025-01-30T20:29:22.637ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130842025-01-30T20:29:22.639ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130852025-01-30T20:29:22.640ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130862025-01-30T20:29:22.641ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130872025-01-30T20:29:22.642ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130882025-01-30T20:29:22.644ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130892025-01-30T20:29:22.644ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130902025-01-30T20:29:22.645ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130912025-01-30T20:29:22.645ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130922025-01-30T20:29:22.647ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130932025-01-30T20:29:22.647ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130942025-01-30T20:29:22.648ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130952025-01-30T20:29:22.652ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9bc122de-f506-4c6d-8101-a7727b3ad959, lookup_type: ById(9bc122de-f506-4c6d-8101-a7727b3ad959) }, key: 2100efc2-a5bc-433f-9aa4-aee5cc503f4f, lookup_type: ById(2100efc2-a5bc-433f-9aa4-aee5cc503f4f) }, key: d59fcf7d-4765-4f60-8946-4e33b60c5af2, lookup_type: ById(d59fcf7d-4765-4f60-8946-4e33b60c5af2) } result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130962025-01-30T20:29:22.652ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance updater_id = 602ecade-933f-4a10-abfa-030976db8d89
130972025-01-30T20:29:22.652ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130982025-01-30T20:29:22.652ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
130992025-01-30T20:29:22.661ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance updater_id = 602ecade-933f-4a10-abfa-030976db8d89
131002025-01-30T20:29:22.661ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
131012025-01-30T20:29:22.661ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance
131022025-01-30T20:29:22.668ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 locked_gen = Generation(Generation(2)) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = LockInstance updater_id = 602ecade-933f-4a10-abfa-030976db8d89
131032025-01-30T20:29:22.668ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131042025-01-30T20:29:22.668ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("602ecade-933f-4a10-abfa-030976db8d89")}) node_id = 1 saga_id = 57925e49-8990-4ce2-8703-242158ae3405
131052025-01-30T20:29:22.671ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131062025-01-30T20:29:22.671ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 57925e49-8990-4ce2-8703-242158ae3405
131072025-01-30T20:29:22.680ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
131082025-01-30T20:29:22.681ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
131092025-01-30T20:29:22.682ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
131102025-01-30T20:29:22.682ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
131112025-01-30T20:29:22.683ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
131122025-01-30T20:29:22.683ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
131132025-01-30T20:29:22.684ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
131142025-01-30T20:29:22.687ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9bc122de-f506-4c6d-8101-a7727b3ad959, lookup_type: ById(9bc122de-f506-4c6d-8101-a7727b3ad959) }, key: 2100efc2-a5bc-433f-9aa4-aee5cc503f4f, lookup_type: ById(2100efc2-a5bc-433f-9aa4-aee5cc503f4f) }, key: d59fcf7d-4765-4f60-8946-4e33b60c5af2, lookup_type: ById(d59fcf7d-4765-4f60-8946-4e33b60c5af2) } result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
131152025-01-30T20:29:22.687ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
131162025-01-30T20:29:22.687ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
131172025-01-30T20:29:22.697ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: a7d75321-6410-4aa2-8dba-96cd43cec01a, time_created: 2025-01-30T20:29:01.875036Z, time_deleted: None, instance_id: d59fcf7d-4765-4f60-8946-4e33b60c5af2, sled_id: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-30T20:29:22.511842Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-30T20:28:59.409724Z, gen: Generation(Generation(3)), propolis_id: Some(a7d75321-6410-4aa2-8dba-96cd43cec01a), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(a7d75321-6410-4aa2-8dba-96cd43cec01a (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-30T20:29:22.693071932Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
131182025-01-30T20:29:22.702ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
131192025-01-30T20:29:22.704ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"d59fcf7d-4765-4f60-8946-4e33b60c5af2","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"a7d75321-6410-4aa2-8dba-96cd43cec01a"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"d59fcf7d-4765-4f60-8946-4e33b60c5af2","lookup_type":{"ById":"d59fcf7d-4765-4f60-8946-4e33b60c5af2"},"parent":{"key":"2100efc2-a5bc-433f-9aa4-aee5cc503f4f","lookup_type":{"ById":"2100efc2-a5bc-433f-9aa4-aee5cc503f4f"},"parent":{"key":"9bc122de-f506-4c6d-8101-a7727b3ad959","lookup_type":{"ById":"9bc122de-f506-4c6d-8101-a7727b3ad959"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"602ecade-933f-4a10-abfa-030976db8d89"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"2100efc2-a5bc-433f-9aa4-aee5cc503f4f","ram_diff":1073741824},"destroy_active_vmm":"a7d75321-6410-4aa2-8dba-96cd43cec01a","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-30T20:29:22.693071932Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131202025-01-30T20:29:22.704ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
131212025-01-30T20:29:22.707ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
131222025-01-30T20:29:22.707ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131232025-01-30T20:29:22.707ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131242025-01-30T20:29:22.707ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131252025-01-30T20:29:22.711ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131262025-01-30T20:29:22.711ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131272025-01-30T20:29:22.714ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131282025-01-30T20:29:22.714ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131292025-01-30T20:29:22.717ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131302025-01-30T20:29:22.717ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b17b65e6-67e7-4e2e-bc7c-3edccd84b301")) node_id = 0 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131312025-01-30T20:29:22.720ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131322025-01-30T20:29:22.720ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131332025-01-30T20:29:22.723ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 parent_lock = UpdaterLock { updater_id: 602ecade-933f-4a10-abfa-030976db8d89, locked_gen: Generation(Generation(2)) } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
131342025-01-30T20:29:22.723ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = BecomeUpdater
131352025-01-30T20:29:22.724ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = BecomeUpdater
131362025-01-30T20:29:22.730ZDEBGnexus (SagaExecutor): inherited lock from 602ecade-933f-4a10-abfa-030976db8d89 to b17b65e6-67e7-4e2e-bc7c-3edccd84b301 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 602ecade-933f-4a10-abfa-030976db8d89 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = BecomeUpdater updater_id = b17b65e6-67e7-4e2e-bc7c-3edccd84b301
131372025-01-30T20:29:22.730ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
131382025-01-30T20:29:22.730ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131392025-01-30T20:29:22.730ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("b17b65e6-67e7-4e2e-bc7c-3edccd84b301")}) node_id = 1 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131402025-01-30T20:29:22.733ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131412025-01-30T20:29:22.733ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131422025-01-30T20:29:22.736ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131432025-01-30T20:29:22.736ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131442025-01-30T20:29:22.739ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131452025-01-30T20:29:22.739ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131462025-01-30T20:29:22.742ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
131472025-01-30T20:29:22.742ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2
131482025-01-30T20:29:22.744ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = UpdateNetworkConfig
131492025-01-30T20:29:22.745ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = UpdateNetworkConfig
131502025-01-30T20:29:22.748ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = UpdateNetworkConfig
131512025-01-30T20:29:22.748ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = UpdateNetworkConfig
131522025-01-30T20:29:22.753ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
131532025-01-30T20:29:22.753ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = UpdateNetworkConfig
131542025-01-30T20:29:22.753ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = UpdateNetworkConfig
131552025-01-30T20:29:22.755ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
131562025-01-30T20:29:22.755ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
131572025-01-30T20:29:22.756ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
131582025-01-30T20:29:22.757ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
131592025-01-30T20:29:22.758ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
131602025-01-30T20:29:22.758ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
131612025-01-30T20:29:22.758ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
131622025-01-30T20:29:22.764ZDEBGnexus: notifying dendrite of updates instance_id = Some(d59fcf7d-4765-4f60-8946-4e33b60c5af2 (instance)) switch = switch0
131632025-01-30T20:29:22.764ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2913, tv_nsec: 974003094 } })
131642025-01-30T20:29:22.764ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1155
131652025-01-30T20:29:22.794ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
131662025-01-30T20:29:22.794ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131672025-01-30T20:29:22.795ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81936f49-21ab-4c7f-a480-7d3b946ec074", "content-length": "26", "date": "Thu, 30 Jan 2025 20:29:22 GMT"} })
131682025-01-30T20:29:22.795ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
131692025-01-30T20:29:22.795ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
131702025-01-30T20:29:22.824ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
131712025-01-30T20:29:22.824ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c9753b0-b63f-4b97-b434-57779ecd7653", "content-length": "4", "date": "Thu, 30 Jan 2025 20:29:22 GMT"} })
131722025-01-30T20:29:22.825ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131732025-01-30T20:29:22.825ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131742025-01-30T20:29:22.829ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131752025-01-30T20:29:22.829ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131762025-01-30T20:29:22.836ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ReleaseVirtualProvisioning
131772025-01-30T20:29:22.837ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ReleaseVirtualProvisioning
131782025-01-30T20:29:22.851ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-30T20:29:22.839803Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 2100efc2-a5bc-433f-9aa4-aee5cc503f4f, time_modified: Some(2025-01-30T20:29:22.839803Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, time_modified: Some(2025-01-30T20:29:22.839803Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
131792025-01-30T20:29:22.851ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131802025-01-30T20:29:22.851ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131812025-01-30T20:29:22.854ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131822025-01-30T20:29:22.854ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131832025-01-30T20:29:22.858ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
131842025-01-30T20:29:22.858ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = UnassignOximeterProducer
131852025-01-30T20:29:22.858ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = UnassignOximeterProducer
131862025-01-30T20:29:22.867ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 623434f7-1950-4ff8-a21d-872e401e4248 producer_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
131872025-01-30T20:29:22.867ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = UnassignOximeterProducer
131882025-01-30T20:29:22.867ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = UnassignOximeterProducer
131892025-01-30T20:29:22.905ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
131902025-01-30T20:29:22.905ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = d59fcf7d-4765-4f60-8946-4e33b60c5af2 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/d59fcf7d-4765-4f60-8946-4e33b60c5af2
131912025-01-30T20:29:22.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2c5d47d4-0467-4f9e-88cf-916371825120 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
131922025-01-30T20:29:22.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2c5d47d4-0467-4f9e-88cf-916371825120 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
131932025-01-30T20:29:22.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1721 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2c5d47d4-0467-4f9e-88cf-916371825120 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
131942025-01-30T20:29:22.930ZDEBGnexus (SagaExecutor): client response oximeter-collector = d59fcf7d-4765-4f60-8946-4e33b60c5af2 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/d59fcf7d-4765-4f60-8946-4e33b60c5af2", status: 204, headers: {"x-request-id": "9b039e3e-f73d-4485-9d4b-93e73e3b6c96", "date": "Thu, 30 Jan 2025 20:29:22 GMT"} }) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
131952025-01-30T20:29:22.930ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 623434f7-1950-4ff8-a21d-872e401e4248 producer_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
131962025-01-30T20:29:22.932ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131972025-01-30T20:29:22.932ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
131982025-01-30T20:29:22.936ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
131992025-01-30T20:29:22.936ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132002025-01-30T20:29:22.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 40757188-5661-4999-8747-c5094a43a2e0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
132012025-01-30T20:29:22.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 40757188-5661-4999-8747-c5094a43a2e0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
132022025-01-30T20:29:22.942ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 lock = UpdaterLock { updater_id: b17b65e6-67e7-4e2e-bc7c-3edccd84b301, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-30T20:29:22.693071932Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
132032025-01-30T20:29:22.942ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = CommitInstanceUpdates
132042025-01-30T20:29:22.942ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = CommitInstanceUpdates
132052025-01-30T20:29:22.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 40757188-5661-4999-8747-c5094a43a2e0 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
132062025-01-30T20:29:22.976ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 new_runtime = InstanceRuntimeState { time_updated: 2025-01-30T20:29:22.693071932Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
132072025-01-30T20:29:22.976ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132082025-01-30T20:29:22.976ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132092025-01-30T20:29:22.976ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
132102025-01-30T20:29:22.976ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
132112025-01-30T20:29:22.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132122025-01-30T20:29:22.976ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
132132025-01-30T20:29:22.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132142025-01-30T20:29:22.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132152025-01-30T20:29:22.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132162025-01-30T20:29:22.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132172025-01-30T20:29:22.980ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132182025-01-30T20:29:22.980ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132192025-01-30T20:29:22.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
132202025-01-30T20:29:22.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132212025-01-30T20:29:22.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132222025-01-30T20:29:22.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132232025-01-30T20:29:22.983ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
132242025-01-30T20:29:22.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132252025-01-30T20:29:22.983ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132262025-01-30T20:29:22.983ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("d59fcf7d-4765-4f60-8946-4e33b60c5af2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a7d75321-6410-4aa2-8dba-96cd43cec01a")}) node_id = 7 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132272025-01-30T20:29:22.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132282025-01-30T20:29:22.987ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132292025-01-30T20:29:22.987ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132302025-01-30T20:29:22.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132312025-01-30T20:29:22.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132322025-01-30T20:29:22.990ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132332025-01-30T20:29:22.990ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132342025-01-30T20:29:22.992ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132352025-01-30T20:29:22.992ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132362025-01-30T20:29:22.995ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
132372025-01-30T20:29:22.995ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ReleaseSledResources
132382025-01-30T20:29:22.996ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ReleaseSledResources
132392025-01-30T20:29:23.002ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132402025-01-30T20:29:23.002ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132412025-01-30T20:29:23.006ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132422025-01-30T20:29:23.006ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132432025-01-30T20:29:23.010ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 propolis_id = a7d75321-6410-4aa2-8dba-96cd43cec01a saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
132442025-01-30T20:29:23.010ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = MarkVmmDeleted
132452025-01-30T20:29:23.010ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = MarkVmmDeleted
132462025-01-30T20:29:23.020ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132472025-01-30T20:29:23.020ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132482025-01-30T20:29:23.024ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132492025-01-30T20:29:23.024ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132502025-01-30T20:29:23.027ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132512025-01-30T20:29:23.027ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132522025-01-30T20:29:23.030ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132532025-01-30T20:29:23.030ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132542025-01-30T20:29:23.034ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ChainSuccessorSaga
132552025-01-30T20:29:23.034ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ChainSuccessorSaga
132562025-01-30T20:29:23.035ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ChainSuccessorSaga
132572025-01-30T20:29:23.035ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ChainSuccessorSaga
132582025-01-30T20:29:23.036ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ChainSuccessorSaga
132592025-01-30T20:29:23.037ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ChainSuccessorSaga
132602025-01-30T20:29:23.038ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ChainSuccessorSaga
132612025-01-30T20:29:23.041ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9bc122de-f506-4c6d-8101-a7727b3ad959, lookup_type: ById(9bc122de-f506-4c6d-8101-a7727b3ad959) }, key: 2100efc2-a5bc-433f-9aa4-aee5cc503f4f, lookup_type: ById(2100efc2-a5bc-433f-9aa4-aee5cc503f4f) }, key: d59fcf7d-4765-4f60-8946-4e33b60c5af2, lookup_type: ById(d59fcf7d-4765-4f60-8946-4e33b60c5af2) } result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ChainSuccessorSaga
132622025-01-30T20:29:23.041ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ChainSuccessorSaga
132632025-01-30T20:29:23.041ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_node = ChainSuccessorSaga
132642025-01-30T20:29:23.047ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update
132652025-01-30T20:29:23.047ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132662025-01-30T20:29:23.047ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132672025-01-30T20:29:23.050ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132682025-01-30T20:29:23.050ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132692025-01-30T20:29:23.053ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132702025-01-30T20:29:23.053ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132712025-01-30T20:29:23.056ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132722025-01-30T20:29:23.056ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a
132732025-01-30T20:29:23.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132742025-01-30T20:29:23.072ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
132752025-01-30T20:29:23.072ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
132762025-01-30T20:29:23.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132772025-01-30T20:29:23.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "48ad8e49-a22d-4eaa-9888-04ac5f768300", "content-length": "372", "date": "Thu, 30 Jan 2025 20:29:23 GMT"} })
132782025-01-30T20:29:23.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132792025-01-30T20:29:23.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132802025-01-30T20:29:23.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132812025-01-30T20:29:23.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
132822025-01-30T20:29:23.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132832025-01-30T20:29:23.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132842025-01-30T20:29:23.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132852025-01-30T20:29:23.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
132862025-01-30T20:29:23.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132872025-01-30T20:29:23.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132882025-01-30T20:29:23.086ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
132892025-01-30T20:29:23.086ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
132902025-01-30T20:29:23.086ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9b9a3a29-b28c-4795-b78a-9e5f9dc04fef", "date": "Thu, 30 Jan 2025 20:29:23 GMT"} })
132912025-01-30T20:29:23.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132922025-01-30T20:29:23.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132932025-01-30T20:29:23.088ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132942025-01-30T20:29:23.088ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a saga_name = instance-update saga_result = SagaResult { saga_id: 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a, saga_log: SagaLog { saga_id: 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("b17b65e6-67e7-4e2e-bc7c-3edccd84b301")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("b17b65e6-67e7-4e2e-bc7c-3edccd84b301")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("d59fcf7d-4765-4f60-8946-4e33b60c5af2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a7d75321-6410-4aa2-8dba-96cd43cec01a")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("d59fcf7d-4765-4f60-8946-4e33b60c5af2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a7d75321-6410-4aa2-8dba-96cd43cec01a")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("b17b65e6-67e7-4e2e-bc7c-3edccd84b301"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("b17b65e6-67e7-4e2e-bc7c-3edccd84b301")}} }) }
132952025-01-30T20:29:23.088ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 2f2cb72c-bd13-4641-bdd1-4f1c0cd3ee2a instance_id = d59fcf7d-4765-4f60-8946-4e33b60c5af2 saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update
132962025-01-30T20:29:23.088ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
132972025-01-30T20:29:23.088ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 57925e49-8990-4ce2-8703-242158ae3405
132982025-01-30T20:29:23.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132992025-01-30T20:29:23.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133002025-01-30T20:29:23.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133012025-01-30T20:29:23.091ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
133022025-01-30T20:29:23.091ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 57925e49-8990-4ce2-8703-242158ae3405
133032025-01-30T20:29:23.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133042025-01-30T20:29:23.093ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
133052025-01-30T20:29:23.094ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 57925e49-8990-4ce2-8703-242158ae3405
133062025-01-30T20:29:23.094ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
133072025-01-30T20:29:23.094ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
133082025-01-30T20:29:23.095ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2dca07fb-296c-485b-bfb2-b8896a87320d", "date": "Thu, 30 Jan 2025 20:29:23 GMT"} })
133092025-01-30T20:29:23.096ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 119.96768ms iteration = 25 status = {}
133102025-01-30T20:29:23.097ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 57925e49-8990-4ce2-8703-242158ae3405 sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
133112025-01-30T20:29:23.097ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 57925e49-8990-4ce2-8703-242158ae3405
133122025-01-30T20:29:23.103ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update sec_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
133132025-01-30T20:29:23.103ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 57925e49-8990-4ce2-8703-242158ae3405 saga_name = start-instance-update saga_result = SagaResult { saga_id: 57925e49-8990-4ce2-8703-242158ae3405, saga_log: SagaLog { saga_id: 57925e49-8990-4ce2-8703-242158ae3405, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("602ecade-933f-4a10-abfa-030976db8d89")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("602ecade-933f-4a10-abfa-030976db8d89")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("602ecade-933f-4a10-abfa-030976db8d89"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("602ecade-933f-4a10-abfa-030976db8d89")}} }) }
133142025-01-30T20:29:23.170ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
133152025-01-30T20:29:23.171ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f7ed42a-e9c2-4c57-b6f9-0010768dc8df", "content-length": "691", "date": "Thu, 30 Jan 2025 20:29:23 GMT"} })
133162025-01-30T20:29:23.171ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
133172025-01-30T20:29:23.171ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
133182025-01-30T20:29:23.171ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
133192025-01-30T20:29:23.172ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 195.64981ms iteration = 25 status = {}
133202025-01-30T20:29:23.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f0a4926b-3ea5-463e-9c24-c0c0987c6c1b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133212025-01-30T20:29:23.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f0a4926b-3ea5-463e-9c24-c0c0987c6c1b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133222025-01-30T20:29:23.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f0a4926b-3ea5-463e-9c24-c0c0987c6c1b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133232025-01-30T20:29:24.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 591bbc84-6475-46e1-b941-ba1811bdc075 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
133242025-01-30T20:29:24.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 591bbc84-6475-46e1-b941-ba1811bdc075 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
133252025-01-30T20:29:24.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 591bbc84-6475-46e1-b941-ba1811bdc075 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
133262025-01-30T20:29:24.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cef95b42-8408-429d-8c0d-1e6ba8e589f9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133272025-01-30T20:29:24.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cef95b42-8408-429d-8c0d-1e6ba8e589f9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133282025-01-30T20:29:24.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cef95b42-8408-429d-8c0d-1e6ba8e589f9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133292025-01-30T20:29:25.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dfc9ce8b-19d6-4ed8-a936-63e64e768eaf roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133302025-01-30T20:29:25.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dfc9ce8b-19d6-4ed8-a936-63e64e768eaf resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133312025-01-30T20:29:25.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = dfc9ce8b-19d6-4ed8-a936-63e64e768eaf response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133322025-01-30T20:29:27.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f2012a03-922f-4de3-81c2-822c7afd0c85 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133332025-01-30T20:29:27.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f2012a03-922f-4de3-81c2-822c7afd0c85 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133342025-01-30T20:29:27.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f2012a03-922f-4de3-81c2-822c7afd0c85 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133352025-01-30T20:29:28.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e31220cf-5bf5-45e6-a88b-6f4c6d75025d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133362025-01-30T20:29:28.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e31220cf-5bf5-45e6-a88b-6f4c6d75025d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133372025-01-30T20:29:28.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = e31220cf-5bf5-45e6-a88b-6f4c6d75025d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133382025-01-30T20:29:29.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3e969fd7-f3be-4a47-bb69-e1afb464ab78 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133392025-01-30T20:29:29.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3e969fd7-f3be-4a47-bb69-e1afb464ab78 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133402025-01-30T20:29:29.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3e969fd7-f3be-4a47-bb69-e1afb464ab78 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133412025-01-30T20:29:30.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 190f9a6a-aa82-458c-ab68-e48f314db46f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133422025-01-30T20:29:30.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 190f9a6a-aa82-458c-ab68-e48f314db46f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133432025-01-30T20:29:30.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 190f9a6a-aa82-458c-ab68-e48f314db46f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
133442025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
133452025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
133462025-01-30T20:29:30.801ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:19:30.801499613 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
133472025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133482025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
133492025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
133502025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133512025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
133522025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
133532025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
133542025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
133552025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
133562025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133572025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
133582025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
133592025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
133602025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133612025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
133622025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
133632025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
133642025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133652025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
133662025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
133672025-01-30T20:29:30.801ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
133682025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.85\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
133692025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
133702025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
133712025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
133722025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
133732025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
133742025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
133752025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
133762025-01-30T20:29:30.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
133772025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
133782025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
133792025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
133802025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
133812025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
133822025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
133832025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
133842025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
133852025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
133862025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
133872025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133882025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
133892025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
133902025-01-30T20:29:30.802ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
133912025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
133922025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
133932025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
133942025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
133952025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
133962025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
133972025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
133982025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
133992025-01-30T20:29:30.802ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
134002025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134012025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
134022025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
134032025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
134042025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
134052025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
134062025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134072025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
134082025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
134092025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
134102025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134112025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
134122025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134132025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
134142025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
134152025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
134162025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134172025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
134182025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
134192025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
134202025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134212025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
134222025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
134232025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134242025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
134252025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
134262025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
134272025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
134282025-01-30T20:29:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2922, tv_nsec: 12164765 } })
134292025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
134302025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
134312025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134322025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
134332025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
134342025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
134352025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
134362025-01-30T20:29:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2922, tv_nsec: 12344460 } })
134372025-01-30T20:29:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
134382025-01-30T20:29:30.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134392025-01-30T20:29:30.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
134402025-01-30T20:29:30.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
134412025-01-30T20:29:30.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
134422025-01-30T20:29:30.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
134432025-01-30T20:29:30.803ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
134442025-01-30T20:29:30.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.45078ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
134452025-01-30T20:29:30.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
134462025-01-30T20:29:30.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
134472025-01-30T20:29:30.803ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
134482025-01-30T20:29:30.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.211533ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
134492025-01-30T20:29:30.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
134502025-01-30T20:29:30.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134512025-01-30T20:29:30.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134522025-01-30T20:29:30.805ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:19:30.801499613 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
134532025-01-30T20:29:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.721873ms iteration = 13 status = {"expiration":"2025-01-30T20:19:30.801499613Z","pruned":[]}
134542025-01-30T20:29:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.923709ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
134552025-01-30T20:29:30.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134562025-01-30T20:29:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
134572025-01-30T20:29:30.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134582025-01-30T20:29:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134592025-01-30T20:29:30.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
134602025-01-30T20:29:30.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
134612025-01-30T20:29:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
134622025-01-30T20:29:30.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134632025-01-30T20:29:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
134642025-01-30T20:29:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134652025-01-30T20:29:30.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134662025-01-30T20:29:30.812ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134672025-01-30T20:29:30.812ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
134682025-01-30T20:29:30.812ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
134692025-01-30T20:29:30.812ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.007205ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
134702025-01-30T20:29:30.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134712025-01-30T20:29:30.814ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.413145ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
134722025-01-30T20:29:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
134732025-01-30T20:29:30.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134742025-01-30T20:29:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134752025-01-30T20:29:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
134762025-01-30T20:29:30.814ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
134772025-01-30T20:29:30.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
134782025-01-30T20:29:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
134792025-01-30T20:29:30.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134802025-01-30T20:29:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134812025-01-30T20:29:30.818ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2922, tv_nsec: 27418278 } })
134822025-01-30T20:29:30.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
134832025-01-30T20:29:30.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
134842025-01-30T20:29:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
134852025-01-30T20:29:30.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
134862025-01-30T20:29:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
134872025-01-30T20:29:30.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2922, tv_nsec: 30916625 } })
134882025-01-30T20:29:30.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134892025-01-30T20:29:30.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
134902025-01-30T20:29:30.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134912025-01-30T20:29:30.822ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134922025-01-30T20:29:30.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134932025-01-30T20:29:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
134942025-01-30T20:29:30.824ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
134952025-01-30T20:29:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134962025-01-30T20:29:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
134972025-01-30T20:29:30.828ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
134982025-01-30T20:29:30.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134992025-01-30T20:29:30.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
135002025-01-30T20:29:30.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135012025-01-30T20:29:30.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2922, tv_nsec: 41085758 } })
135022025-01-30T20:29:30.832ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
135032025-01-30T20:29:30.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 36.672218ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
135042025-01-30T20:29:30.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
135052025-01-30T20:29:30.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
135062025-01-30T20:29:30.844ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
135072025-01-30T20:29:30.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
135082025-01-30T20:29:30.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
135092025-01-30T20:29:30.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.02443ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
135102025-01-30T20:29:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
135112025-01-30T20:29:30.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
135122025-01-30T20:29:30.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135132025-01-30T20:29:30.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135142025-01-30T20:29:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
135152025-01-30T20:29:30.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
135162025-01-30T20:29:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
135172025-01-30T20:29:30.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135182025-01-30T20:29:30.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135192025-01-30T20:29:30.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135202025-01-30T20:29:30.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135212025-01-30T20:29:30.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
135222025-01-30T20:29:30.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
135232025-01-30T20:29:30.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
135242025-01-30T20:29:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
135252025-01-30T20:29:30.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135262025-01-30T20:29:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135272025-01-30T20:29:30.859ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135282025-01-30T20:29:30.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135292025-01-30T20:29:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
135302025-01-30T20:29:30.862ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
135312025-01-30T20:29:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
135322025-01-30T20:29:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
135332025-01-30T20:29:30.862ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135342025-01-30T20:29:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
135352025-01-30T20:29:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
135362025-01-30T20:29:30.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
135372025-01-30T20:29:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
135382025-01-30T20:29:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
135392025-01-30T20:29:30.865ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
135402025-01-30T20:29:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
135412025-01-30T20:29:30.865ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135422025-01-30T20:29:30.866ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135432025-01-30T20:29:30.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
135442025-01-30T20:29:30.868ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
135452025-01-30T20:29:30.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
135462025-01-30T20:29:30.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
135472025-01-30T20:29:30.868ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
135482025-01-30T20:29:30.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
135492025-01-30T20:29:30.868ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135502025-01-30T20:29:30.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135512025-01-30T20:29:30.869ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135522025-01-30T20:29:30.870ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
135532025-01-30T20:29:30.870ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
135542025-01-30T20:29:30.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
135552025-01-30T20:29:30.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
135562025-01-30T20:29:30.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
135572025-01-30T20:29:30.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135582025-01-30T20:29:30.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135592025-01-30T20:29:30.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
135602025-01-30T20:29:30.872ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
135612025-01-30T20:29:30.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
135622025-01-30T20:29:30.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
135632025-01-30T20:29:30.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
135642025-01-30T20:29:30.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
135652025-01-30T20:29:30.873ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
135662025-01-30T20:29:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
135672025-01-30T20:29:30.880ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 78.806367ms iteration = 6 status = {"nsuccess":5}
135682025-01-30T20:29:30.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135692025-01-30T20:29:30.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
135702025-01-30T20:29:30.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135712025-01-30T20:29:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135722025-01-30T20:29:30.883ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135732025-01-30T20:29:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
135742025-01-30T20:29:30.886ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
135752025-01-30T20:29:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
135762025-01-30T20:29:30.887ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
135772025-01-30T20:29:30.887ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.861465ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
135782025-01-30T20:29:30.888ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
135792025-01-30T20:29:30.888ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 86.777748ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
135802025-01-30T20:29:30.889ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
135812025-01-30T20:29:30.889ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.28614ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
135822025-01-30T20:29:30.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135832025-01-30T20:29:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135842025-01-30T20:29:30.893ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
135852025-01-30T20:29:30.893ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
135862025-01-30T20:29:30.893ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
135872025-01-30T20:29:30.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
135882025-01-30T20:29:30.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
135892025-01-30T20:29:30.893ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
135902025-01-30T20:29:30.893ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
135912025-01-30T20:29:30.893ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
135922025-01-30T20:29:30.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
135932025-01-30T20:29:30.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
135942025-01-30T20:29:30.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.032076ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
135952025-01-30T20:29:30.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
135962025-01-30T20:29:30.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
135972025-01-30T20:29:30.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.431689ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
135982025-01-30T20:29:30.910ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
135992025-01-30T20:29:30.910ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
136002025-01-30T20:29:30.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
136012025-01-30T20:29:30.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 109.241752ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
136022025-01-30T20:29:30.914ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
136032025-01-30T20:29:30.914ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
136042025-01-30T20:29:30.914ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 112.511143ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
136052025-01-30T20:29:30.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.984543ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
136062025-01-30T20:29:30.917ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
136072025-01-30T20:29:30.917ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
136082025-01-30T20:29:30.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
136092025-01-30T20:29:30.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
136102025-01-30T20:29:30.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
136112025-01-30T20:29:30.956ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
136122025-01-30T20:29:30.956ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
136132025-01-30T20:29:30.956ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "51276024-df5a-445a-b999-8982c67a7d81", "content-length": "26", "date": "Thu, 30 Jan 2025 20:29:30 GMT"} })
136142025-01-30T20:29:30.956ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
136152025-01-30T20:29:30.958ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
136162025-01-30T20:29:30.959ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136172025-01-30T20:29:30.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136182025-01-30T20:29:30.963ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
136192025-01-30T20:29:30.963ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
136202025-01-30T20:29:30.963ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "581c53f8-31d1-4709-8a88-c53978aa5551", "content-length": "26", "date": "Thu, 30 Jan 2025 20:29:30 GMT"} })
136212025-01-30T20:29:30.963ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
136222025-01-30T20:29:30.965ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
136232025-01-30T20:29:30.978ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 176.507338ms iteration = 28 status = {"physical_disks_added":0}
136242025-01-30T20:29:30.984ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
136252025-01-30T20:29:30.984ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
136262025-01-30T20:29:30.984ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cc8053d-35ec-4c18-b006-a06a09c34544", "content-length": "26", "date": "Thu, 30 Jan 2025 20:29:30 GMT"} })
136272025-01-30T20:29:30.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
136282025-01-30T20:29:30.986ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
136292025-01-30T20:29:31.092ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
136302025-01-30T20:29:31.093ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c040279a-6835-4bc1-a4c6-7e034a311ddd", "date": "Thu, 30 Jan 2025 20:29:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
136312025-01-30T20:29:31.093ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
136322025-01-30T20:29:31.094ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cb19cdf5-c172-4ece-8c74-2735deb08f1a", "date": "Thu, 30 Jan 2025 20:29:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
136332025-01-30T20:29:31.094ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
136342025-01-30T20:29:31.095ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
136352025-01-30T20:29:31.095ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 293.238979ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
136362025-01-30T20:29:31.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 91a20eba-a085-484f-9299-5a512ef748a7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
136372025-01-30T20:29:31.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 91a20eba-a085-484f-9299-5a512ef748a7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
136382025-01-30T20:29:31.124ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
136392025-01-30T20:29:31.124ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
136402025-01-30T20:29:31.124ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3418bbe6-ea18-4a6c-a86f-04fb65c75abb", "content-length": "372", "date": "Thu, 30 Jan 2025 20:29:31 GMT"} })
136412025-01-30T20:29:31.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136422025-01-30T20:29:31.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136432025-01-30T20:29:31.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136442025-01-30T20:29:31.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136452025-01-30T20:29:31.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136462025-01-30T20:29:31.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136472025-01-30T20:29:31.128ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136482025-01-30T20:29:31.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 22148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 91a20eba-a085-484f-9299-5a512ef748a7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
136492025-01-30T20:29:31.130ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
136502025-01-30T20:29:31.130ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
136512025-01-30T20:29:31.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
136522025-01-30T20:29:31.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
136532025-01-30T20:29:31.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136542025-01-30T20:29:31.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136552025-01-30T20:29:31.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
136562025-01-30T20:29:31.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
136572025-01-30T20:29:31.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
136582025-01-30T20:29:31.134ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136592025-01-30T20:29:31.137ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
136602025-01-30T20:29:31.137ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136612025-01-30T20:29:31.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136622025-01-30T20:29:31.186ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
136632025-01-30T20:29:31.188ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
136642025-01-30T20:29:31.188ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
136652025-01-30T20:29:31.188ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 385.966222ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
136662025-01-30T20:29:31.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136672025-01-30T20:29:31.188ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
136682025-01-30T20:29:31.188ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 386.770415ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
136692025-01-30T20:29:31.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
136702025-01-30T20:29:31.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
136712025-01-30T20:29:31.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
136722025-01-30T20:29:31.193ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
136732025-01-30T20:29:31.193ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
136742025-01-30T20:29:31.193ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
136752025-01-30T20:29:31.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
136762025-01-30T20:29:31.198ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
136772025-01-30T20:29:31.198ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 397.40417ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
136782025-01-30T20:29:31.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136792025-01-30T20:29:31.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
136802025-01-30T20:29:31.207ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136812025-01-30T20:29:31.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136822025-01-30T20:29:31.218ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
136832025-01-30T20:29:31.218ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
136842025-01-30T20:29:31.219ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4d24d516-941c-4fa7-87c6-b8a635be5ad7", "date": "Thu, 30 Jan 2025 20:29:31 GMT"} })
136852025-01-30T20:29:31.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136862025-01-30T20:29:31.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136872025-01-30T20:29:31.229ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 427.353051ms iteration = 25 status = {}
136882025-01-30T20:29:31.233ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
136892025-01-30T20:29:31.233ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
136902025-01-30T20:29:31.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
136912025-01-30T20:29:31.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
136922025-01-30T20:29:31.236ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
136932025-01-30T20:29:31.236ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ded380f1-9d56-43b0-a9cc-8e50d40dfe22", "content-length": "2", "date": "Thu, 30 Jan 2025 20:29:30 GMT"} })
136942025-01-30T20:29:31.239ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
136952025-01-30T20:29:31.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
136962025-01-30T20:29:31.272ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
136972025-01-30T20:29:31.273ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c82a698-e652-43f4-961a-7ea4eae7ba73", "content-length": "691", "date": "Thu, 30 Jan 2025 20:29:31 GMT"} })
136982025-01-30T20:29:31.273ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
136992025-01-30T20:29:31.273ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
137002025-01-30T20:29:31.273ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
137012025-01-30T20:29:31.274ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 473.341878ms iteration = 26 status = {}
137022025-01-30T20:29:31.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137032025-01-30T20:29:31.279ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 478.277045ms iteration = 25 status = 0
137042025-01-30T20:29:31.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137052025-01-30T20:29:31.285ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 483.412547ms iteration = 25 status = null
137062025-01-30T20:29:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137072025-01-30T20:29:31.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
137082025-01-30T20:29:31.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
137092025-01-30T20:29:31.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
137102025-01-30T20:29:31.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137112025-01-30T20:29:31.298ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
137122025-01-30T20:29:31.298ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
137132025-01-30T20:29:31.298ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-30 20:18:12.536035 UTC dns_group = internal generation = 1
137142025-01-30T20:29:31.298ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 496.450739ms iteration = 13 status = {"generation":1}
137152025-01-30T20:29:31.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137162025-01-30T20:29:31.303ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
137172025-01-30T20:29:31.303ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
137182025-01-30T20:29:31.303ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2d08fd26-066f-414d-98e9-329b45eb9563", "date": "Thu, 30 Jan 2025 20:29:31 GMT"} })
137192025-01-30T20:29:31.305ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 503.650358ms iteration = 26 status = {}
137202025-01-30T20:29:31.309ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
137212025-01-30T20:29:31.310ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "cb82e983-58ef-467b-8c0b-45c546a0f63e", "date": "Thu, 30 Jan 2025 20:29:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137222025-01-30T20:29:31.310ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137232025-01-30T20:29:31.315ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d13c3830-517b-4463-befe-be7e31320759", "date": "Thu, 30 Jan 2025 20:29:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137242025-01-30T20:29:31.315ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137252025-01-30T20:29:31.317ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "70a5e983-77b4-4a5b-92eb-9f20e951a615", "date": "Thu, 30 Jan 2025 20:29:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137262025-01-30T20:29:31.317ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137272025-01-30T20:29:31.319ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
137282025-01-30T20:29:31.319ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 517.612976ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
137292025-01-30T20:29:31.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137302025-01-30T20:29:31.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
137312025-01-30T20:29:31.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
137322025-01-30T20:29:31.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
137332025-01-30T20:29:31.332ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
137342025-01-30T20:29:31.332ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
137352025-01-30T20:29:31.332ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-30 20:18:13.133071 UTC dns_group = external generation = 2
137362025-01-30T20:29:31.332ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 530.958706ms iteration = 13 status = {"generation":2}
137372025-01-30T20:29:31.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137382025-01-30T20:29:31.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137392025-01-30T20:29:31.342ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
137402025-01-30T20:29:31.342ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137412025-01-30T20:29:31.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137422025-01-30T20:29:31.357ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
137432025-01-30T20:29:31.357ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bf0ffa8-deab-4829-a926-b3cda41a536e", "content-length": "134", "date": "Thu, 30 Jan 2025 20:29:30 GMT"} })
137442025-01-30T20:29:31.357ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
137452025-01-30T20:29:31.357ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
137462025-01-30T20:29:31.358ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
137472025-01-30T20:29:31.358ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
137482025-01-30T20:29:31.358ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
137492025-01-30T20:29:31.358ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
137502025-01-30T20:29:31.358ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
137512025-01-30T20:29:31.358ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
137522025-01-30T20:29:31.358ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
137532025-01-30T20:29:31.358ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
137542025-01-30T20:29:31.358ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
137552025-01-30T20:29:31.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137562025-01-30T20:29:31.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137572025-01-30T20:29:31.362ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
137582025-01-30T20:29:31.362ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ceeb584a-adfb-47e6-a658-e734d9685153", "content-length": "2", "date": "Thu, 30 Jan 2025 20:29:30 GMT"} })
137592025-01-30T20:29:31.362ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
137602025-01-30T20:29:31.362ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9936df2a-772c-4e8a-ac24-d9fa45e42744", "content-length": "52", "date": "Thu, 30 Jan 2025 20:29:30 GMT"} })
137612025-01-30T20:29:31.362ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
137622025-01-30T20:29:31.362ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
137632025-01-30T20:29:31.494ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "30bd8227-13ec-4975-b4c2-fe9a07fab9ab", "date": "Thu, 30 Jan 2025 20:29:31 GMT"} })
137642025-01-30T20:29:31.494ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
137652025-01-30T20:29:31.494ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
137662025-01-30T20:29:31.494ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "98dae526-bac0-4dec-ab0a-57b63afb9cba", "content-length": "682", "date": "Thu, 30 Jan 2025 20:29:31 GMT"} })
137672025-01-30T20:29:31.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137682025-01-30T20:29:31.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137692025-01-30T20:29:31.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137702025-01-30T20:29:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137712025-01-30T20:29:31.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137722025-01-30T20:29:31.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137732025-01-30T20:29:31.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137742025-01-30T20:29:31.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137752025-01-30T20:29:31.513ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 711.994012ms iteration = 25 status = {}
137762025-01-30T20:29:32.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 45692a78-8343-4669-92bb-f535586ea243 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137772025-01-30T20:29:32.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 45692a78-8343-4669-92bb-f535586ea243 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137782025-01-30T20:29:32.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 45692a78-8343-4669-92bb-f535586ea243 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137792025-01-30T20:29:32.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 56abe821-3322-41d2-9dc5-18e224ffd9b8 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
137802025-01-30T20:29:33.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 807beb9a-d1d4-4eb3-8d61-aa2e2c559aec roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137812025-01-30T20:29:33.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 807beb9a-d1d4-4eb3-8d61-aa2e2c559aec resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137822025-01-30T20:29:33.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 807beb9a-d1d4-4eb3-8d61-aa2e2c559aec response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137832025-01-30T20:29:34.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 23583b3d-7f1b-4980-b224-55352a1dd63d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137842025-01-30T20:29:34.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 23583b3d-7f1b-4980-b224-55352a1dd63d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137852025-01-30T20:29:34.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 23583b3d-7f1b-4980-b224-55352a1dd63d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137862025-01-30T20:29:35.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a93c823-8f06-4c9f-bdf7-5d1fd4fbd1f7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137872025-01-30T20:29:35.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a93c823-8f06-4c9f-bdf7-5d1fd4fbd1f7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137882025-01-30T20:29:35.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a93c823-8f06-4c9f-bdf7-5d1fd4fbd1f7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137892025-01-30T20:29:36.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c77b8c59-9cb7-46df-9090-2a27ae58bf12 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137902025-01-30T20:29:36.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c77b8c59-9cb7-46df-9090-2a27ae58bf12 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137912025-01-30T20:29:36.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c77b8c59-9cb7-46df-9090-2a27ae58bf12 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137922025-01-30T20:29:37.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2cefacf8-cb19-4e2b-a26b-a9905d12c60d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137932025-01-30T20:29:37.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2cefacf8-cb19-4e2b-a26b-a9905d12c60d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137942025-01-30T20:29:37.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2cefacf8-cb19-4e2b-a26b-a9905d12c60d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137952025-01-30T20:29:38.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 679265b5-28ff-418c-adb5-07f32dc27841 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137962025-01-30T20:29:38.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 679265b5-28ff-418c-adb5-07f32dc27841 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137972025-01-30T20:29:38.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 679265b5-28ff-418c-adb5-07f32dc27841 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137982025-01-30T20:29:39.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a3bd49b7-6a45-4b41-9990-02eeb4f547aa roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
137992025-01-30T20:29:39.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a3bd49b7-6a45-4b41-9990-02eeb4f547aa resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138002025-01-30T20:29:39.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a3bd49b7-6a45-4b41-9990-02eeb4f547aa response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138012025-01-30T20:29:40.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8d255303-a144-4ece-8a12-64b027eab64f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138022025-01-30T20:29:40.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8d255303-a144-4ece-8a12-64b027eab64f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138032025-01-30T20:29:40.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8d255303-a144-4ece-8a12-64b027eab64f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138042025-01-30T20:29:40.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
138052025-01-30T20:29:40.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
138062025-01-30T20:29:40.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138072025-01-30T20:29:40.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138082025-01-30T20:29:40.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138092025-01-30T20:29:40.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138102025-01-30T20:29:40.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138112025-01-30T20:29:40.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138122025-01-30T20:29:40.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138132025-01-30T20:29:40.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
138142025-01-30T20:29:40.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138152025-01-30T20:29:40.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138162025-01-30T20:29:40.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138172025-01-30T20:29:40.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138182025-01-30T20:29:40.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138192025-01-30T20:29:40.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
138202025-01-30T20:29:40.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138212025-01-30T20:29:40.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138222025-01-30T20:29:40.857ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
138232025-01-30T20:29:40.857ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.20136ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
138242025-01-30T20:29:40.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.920237ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
138252025-01-30T20:29:41.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a63a2019-5462-4970-8e6d-75856033b675 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138262025-01-30T20:29:41.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a63a2019-5462-4970-8e6d-75856033b675 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138272025-01-30T20:29:41.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a63a2019-5462-4970-8e6d-75856033b675 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138282025-01-30T20:29:42.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 439741d0-ca97-46f3-bfe8-464fcac901d7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138292025-01-30T20:29:42.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 439741d0-ca97-46f3-bfe8-464fcac901d7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138302025-01-30T20:29:42.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 439741d0-ca97-46f3-bfe8-464fcac901d7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138312025-01-30T20:29:42.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 610 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 502ff72c-3b9f-4a82-8562-4b55149565df response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
138322025-01-30T20:29:43.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c654bd6d-ba00-4f92-b961-beb5a985e88d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138332025-01-30T20:29:43.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c654bd6d-ba00-4f92-b961-beb5a985e88d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138342025-01-30T20:29:43.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c654bd6d-ba00-4f92-b961-beb5a985e88d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138352025-01-30T20:29:44.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d6737c15-1178-4485-8556-a09de1c2d58a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138362025-01-30T20:29:44.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d6737c15-1178-4485-8556-a09de1c2d58a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138372025-01-30T20:29:44.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d6737c15-1178-4485-8556-a09de1c2d58a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138382025-01-30T20:29:45.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 28487faa-a594-4197-a6c4-620c394de2d2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138392025-01-30T20:29:45.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 28487faa-a594-4197-a6c4-620c394de2d2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138402025-01-30T20:29:45.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 28487faa-a594-4197-a6c4-620c394de2d2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138412025-01-30T20:29:46.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1dc5c7ca-68bf-4ea9-9073-e5739c358d4d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138422025-01-30T20:29:46.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1dc5c7ca-68bf-4ea9-9073-e5739c358d4d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138432025-01-30T20:29:46.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1dc5c7ca-68bf-4ea9-9073-e5739c358d4d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138442025-01-30T20:29:47.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4647c29a-036b-4eae-acdf-c0e5fabd8854 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138452025-01-30T20:29:47.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4647c29a-036b-4eae-acdf-c0e5fabd8854 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138462025-01-30T20:29:47.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4647c29a-036b-4eae-acdf-c0e5fabd8854 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138472025-01-30T20:29:48.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f7baff7-63dc-4d75-a03b-27051b64caf0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138482025-01-30T20:29:48.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f7baff7-63dc-4d75-a03b-27051b64caf0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138492025-01-30T20:29:48.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4f7baff7-63dc-4d75-a03b-27051b64caf0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138502025-01-30T20:29:49.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a0b5e8a2-8bd9-4fcb-90ae-919689f6bb3b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138512025-01-30T20:29:49.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a0b5e8a2-8bd9-4fcb-90ae-919689f6bb3b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138522025-01-30T20:29:49.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a0b5e8a2-8bd9-4fcb-90ae-919689f6bb3b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138532025-01-30T20:29:50.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d8a8ae05-ba50-4ad9-bbd5-80dd9dacc18e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138542025-01-30T20:29:50.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d8a8ae05-ba50-4ad9-bbd5-80dd9dacc18e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138552025-01-30T20:29:50.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d8a8ae05-ba50-4ad9-bbd5-80dd9dacc18e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138562025-01-30T20:29:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
138572025-01-30T20:29:50.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
138582025-01-30T20:29:50.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138592025-01-30T20:29:50.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138602025-01-30T20:29:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138612025-01-30T20:29:50.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138622025-01-30T20:29:50.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138632025-01-30T20:29:50.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138642025-01-30T20:29:50.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138652025-01-30T20:29:50.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.381421ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
138662025-01-30T20:29:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
138672025-01-30T20:29:50.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138682025-01-30T20:29:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138692025-01-30T20:29:50.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138702025-01-30T20:29:50.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138712025-01-30T20:29:50.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138722025-01-30T20:29:50.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
138732025-01-30T20:29:50.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138742025-01-30T20:29:50.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138752025-01-30T20:29:50.853ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
138762025-01-30T20:29:50.853ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.407717ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
138772025-01-30T20:29:51.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c7c89669-4525-47ad-99b7-5aaaf3806522 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138782025-01-30T20:29:51.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c7c89669-4525-47ad-99b7-5aaaf3806522 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138792025-01-30T20:29:51.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c7c89669-4525-47ad-99b7-5aaaf3806522 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138802025-01-30T20:29:52.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 514 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 69d740c9-3069-44e4-bb5b-56e80cde2712 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
138812025-01-30T20:29:52.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5ba09e07-7e4d-4c22-81d9-51e5b36fc44f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138822025-01-30T20:29:52.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5ba09e07-7e4d-4c22-81d9-51e5b36fc44f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138832025-01-30T20:29:52.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5ba09e07-7e4d-4c22-81d9-51e5b36fc44f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138842025-01-30T20:29:53.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cf2e6d59-2d6a-4e65-9787-a21253dfb75d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138852025-01-30T20:29:53.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cf2e6d59-2d6a-4e65-9787-a21253dfb75d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138862025-01-30T20:29:53.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = cf2e6d59-2d6a-4e65-9787-a21253dfb75d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138872025-01-30T20:29:54.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4c67b3e3-1ac5-4782-a82d-c0c3c83952bb roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138882025-01-30T20:29:54.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4c67b3e3-1ac5-4782-a82d-c0c3c83952bb resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138892025-01-30T20:29:54.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4c67b3e3-1ac5-4782-a82d-c0c3c83952bb response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138902025-01-30T20:29:54.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = f04e148e-4f8f-4de8-a167-130e8ea95313 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
138912025-01-30T20:29:54.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = f04e148e-4f8f-4de8-a167-130e8ea95313 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
138922025-01-30T20:29:54.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = f04e148e-4f8f-4de8-a167-130e8ea95313 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
138932025-01-30T20:29:55.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a8d5464-7ebc-4405-91e6-0beb60f9de6e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138942025-01-30T20:29:55.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a8d5464-7ebc-4405-91e6-0beb60f9de6e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138952025-01-30T20:29:55.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6a8d5464-7ebc-4405-91e6-0beb60f9de6e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138962025-01-30T20:29:56.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8a62dcb3-ca3b-402b-aa17-9c72fb55bfbf roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138972025-01-30T20:29:56.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8a62dcb3-ca3b-402b-aa17-9c72fb55bfbf resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138982025-01-30T20:29:56.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8a62dcb3-ca3b-402b-aa17-9c72fb55bfbf response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
138992025-01-30T20:29:57.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2042617a-9b89-44a4-9910-90194500605a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
139002025-01-30T20:29:57.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2042617a-9b89-44a4-9910-90194500605a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
139012025-01-30T20:29:57.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 2042617a-9b89-44a4-9910-90194500605a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
139022025-01-30T20:29:58.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 18744c0c-ead4-449f-bb04-2b1e604ed6d6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
139032025-01-30T20:29:58.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 18744c0c-ead4-449f-bb04-2b1e604ed6d6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
139042025-01-30T20:29:58.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 18744c0c-ead4-449f-bb04-2b1e604ed6d6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
139052025-01-30T20:29:59.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fdbe9f9c-0559-4a6c-9b08-3ecffe7d702d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
139062025-01-30T20:29:59.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fdbe9f9c-0559-4a6c-9b08-3ecffe7d702d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
139072025-01-30T20:29:59.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fdbe9f9c-0559-4a6c-9b08-3ecffe7d702d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
139082025-01-30T20:30:00.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ced5f82a-8e8d-48d5-9158-08be39e29c83 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
139092025-01-30T20:30:00.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ced5f82a-8e8d-48d5-9158-08be39e29c83 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
139102025-01-30T20:30:00.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2664 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ced5f82a-8e8d-48d5-9158-08be39e29c83 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
139112025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
139122025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
139132025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
139142025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139152025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
139162025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
139172025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
139182025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
139192025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
139202025-01-30T20:30:00.801ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
139212025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139222025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
139232025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
139242025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
139252025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139262025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
139272025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
139282025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
139292025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
139302025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
139312025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
139322025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
139332025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
139342025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
139352025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139362025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139372025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
139382025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
139392025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
139402025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
139412025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
139422025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
139432025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
139442025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
139452025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
139462025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139472025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
139482025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
139492025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139502025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
139512025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
139522025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139532025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139542025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
139552025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
139562025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
139572025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139582025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
139592025-01-30T20:30:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
139602025-01-30T20:30:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139612025-01-30T20:30:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
139622025-01-30T20:30:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139632025-01-30T20:30:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
139642025-01-30T20:30:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139652025-01-30T20:30:00.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139662025-01-30T20:30:00.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139672025-01-30T20:30:00.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.812033ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
139682025-01-30T20:30:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
139692025-01-30T20:30:00.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
139702025-01-30T20:30:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
139712025-01-30T20:30:00.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139722025-01-30T20:30:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
139732025-01-30T20:30:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139742025-01-30T20:30:00.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2952, tv_nsec: 18733437 } })
139752025-01-30T20:30:00.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
139762025-01-30T20:30:00.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2952, tv_nsec: 22085120 } })
139772025-01-30T20:30:00.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139782025-01-30T20:30:00.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
139792025-01-30T20:30:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
139802025-01-30T20:30:00.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
139812025-01-30T20:30:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139822025-01-30T20:30:00.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139832025-01-30T20:30:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139842025-01-30T20:30:00.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
139852025-01-30T20:30:00.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139862025-01-30T20:30:00.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139872025-01-30T20:30:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139882025-01-30T20:30:00.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
139892025-01-30T20:30:00.852ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
139902025-01-30T20:30:00.852ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
139912025-01-30T20:30:00.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
139922025-01-30T20:30:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
139932025-01-30T20:30:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
139942025-01-30T20:30:00.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139952025-01-30T20:30:00.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
139962025-01-30T20:30:00.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139972025-01-30T20:30:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139982025-01-30T20:30:00.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.383099ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
139992025-01-30T20:30:00.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.027317ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
140002025-01-30T20:30:00.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140012025-01-30T20:30:00.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
140022025-01-30T20:30:00.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
140032025-01-30T20:30:00.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
140042025-01-30T20:30:00.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
140052025-01-30T20:30:00.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140062025-01-30T20:30:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
140072025-01-30T20:30:00.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140082025-01-30T20:30:00.860ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
140092025-01-30T20:30:00.860ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 59.292385ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
140102025-01-30T20:30:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140112025-01-30T20:30:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
140122025-01-30T20:30:00.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140132025-01-30T20:30:00.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140142025-01-30T20:30:00.861ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
140152025-01-30T20:30:00.861ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
140162025-01-30T20:30:00.862ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5efeee1-b352-4e4e-a082-a929a114e662", "content-length": "26", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
140172025-01-30T20:30:00.862ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
140182025-01-30T20:30:00.863ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140192025-01-30T20:30:00.863ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
140202025-01-30T20:30:00.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140212025-01-30T20:30:00.864ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2952, tv_nsec: 74202297 } })
140222025-01-30T20:30:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140232025-01-30T20:30:00.865ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
140242025-01-30T20:30:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
140252025-01-30T20:30:00.865ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
140262025-01-30T20:30:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
140272025-01-30T20:30:00.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140282025-01-30T20:30:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
140292025-01-30T20:30:00.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140302025-01-30T20:30:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140312025-01-30T20:30:00.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140322025-01-30T20:30:00.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
140332025-01-30T20:30:00.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140342025-01-30T20:30:00.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140352025-01-30T20:30:00.880ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
140362025-01-30T20:30:00.880ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.645261ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
140372025-01-30T20:30:00.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.628286ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
140382025-01-30T20:30:00.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140392025-01-30T20:30:00.883ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
140402025-01-30T20:30:00.883ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
140412025-01-30T20:30:00.883ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
140422025-01-30T20:30:00.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
140432025-01-30T20:30:00.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
140442025-01-30T20:30:00.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140452025-01-30T20:30:00.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140462025-01-30T20:30:00.891ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
140472025-01-30T20:30:00.891ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
140482025-01-30T20:30:00.891ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52694409-35f7-4e08-b5e4-50b7e3cc4a50", "content-length": "26", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
140492025-01-30T20:30:00.891ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
140502025-01-30T20:30:00.893ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
140512025-01-30T20:30:00.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140522025-01-30T20:30:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140532025-01-30T20:30:00.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140542025-01-30T20:30:00.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140552025-01-30T20:30:00.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
140562025-01-30T20:30:00.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
140572025-01-30T20:30:00.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.318181ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
140582025-01-30T20:30:00.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140592025-01-30T20:30:00.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.3382ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
140602025-01-30T20:30:00.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
140612025-01-30T20:30:00.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140622025-01-30T20:30:00.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140632025-01-30T20:30:00.906ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.949023ms iteration = 26 status = 0
140642025-01-30T20:30:00.910ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
140652025-01-30T20:30:00.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
140662025-01-30T20:30:00.912ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140672025-01-30T20:30:00.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
140682025-01-30T20:30:00.915ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
140692025-01-30T20:30:00.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
140702025-01-30T20:30:00.922ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
140712025-01-30T20:30:00.922ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
140722025-01-30T20:30:00.922ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.505322ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
140732025-01-30T20:30:00.928ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.469468ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
140742025-01-30T20:30:00.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
140752025-01-30T20:30:00.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
140762025-01-30T20:30:00.942ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
140772025-01-30T20:30:00.942ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 141.364793ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
140782025-01-30T20:30:00.955ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 153.961703ms iteration = 26 status = {}
140792025-01-30T20:30:00.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
140802025-01-30T20:30:00.960ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
140812025-01-30T20:30:00.961ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bb74eff-6a85-4393-ba63-a4821d89e44a", "content-length": "26", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
140822025-01-30T20:30:00.961ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
140832025-01-30T20:30:00.963ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
140842025-01-30T20:30:00.972ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
140852025-01-30T20:30:00.972ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c43cf287-6f00-4e70-9aa5-b59ce23aa9ea", "content-length": "2", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
140862025-01-30T20:30:00.974ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
140872025-01-30T20:30:00.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
140882025-01-30T20:30:00.976ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 175.11452ms iteration = 26 status = null
140892025-01-30T20:30:00.980ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 179.128032ms iteration = 29 status = {"physical_disks_added":0}
140902025-01-30T20:30:00.993ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
140912025-01-30T20:30:00.993ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
140922025-01-30T20:30:00.993ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "98fd4af5-e1b0-4b11-a24a-7b3e5d21f6e6", "content-length": "372", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
140932025-01-30T20:30:00.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140942025-01-30T20:30:00.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140952025-01-30T20:30:01.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
140962025-01-30T20:30:01.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
140972025-01-30T20:30:01.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140982025-01-30T20:30:01.039ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
140992025-01-30T20:30:01.039ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
141002025-01-30T20:30:01.040ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ef0e3a7c-987a-450b-b032-008610b14503", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
141012025-01-30T20:30:01.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141022025-01-30T20:30:01.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
141032025-01-30T20:30:01.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141042025-01-30T20:30:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141052025-01-30T20:30:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141062025-01-30T20:30:01.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141072025-01-30T20:30:01.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141082025-01-30T20:30:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141092025-01-30T20:30:01.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
141102025-01-30T20:30:01.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141112025-01-30T20:30:01.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141122025-01-30T20:30:01.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141132025-01-30T20:30:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141142025-01-30T20:30:01.049ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
141152025-01-30T20:30:01.049ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
141162025-01-30T20:30:01.049ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8e2b0141-6628-49e6-acc5-42e9841318dc", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
141172025-01-30T20:30:01.050ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 249.488985ms iteration = 27 status = {}
141182025-01-30T20:30:01.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141192025-01-30T20:30:01.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141202025-01-30T20:30:01.066ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
141212025-01-30T20:30:01.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141222025-01-30T20:30:01.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141232025-01-30T20:30:01.079ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
141242025-01-30T20:30:01.080ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a38b68fe-5495-4810-a106-204a005a051a", "content-length": "134", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
141252025-01-30T20:30:01.080ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
141262025-01-30T20:30:01.080ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
141272025-01-30T20:30:01.080ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
141282025-01-30T20:30:01.080ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
141292025-01-30T20:30:01.080ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141302025-01-30T20:30:01.080ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141312025-01-30T20:30:01.080ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141322025-01-30T20:30:01.080ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
141332025-01-30T20:30:01.080ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141342025-01-30T20:30:01.080ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
141352025-01-30T20:30:01.080ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
141362025-01-30T20:30:01.080ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141372025-01-30T20:30:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141382025-01-30T20:30:01.083ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
141392025-01-30T20:30:01.083ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cd1874d-cf02-4211-acfe-a6f38f020f3f", "content-length": "2", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
141402025-01-30T20:30:01.083ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
141412025-01-30T20:30:01.083ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f421909-dd64-4da8-a298-96c10ac4298e", "content-length": "52", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
141422025-01-30T20:30:01.083ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
141432025-01-30T20:30:01.083ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
141442025-01-30T20:30:01.152ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
141452025-01-30T20:30:01.219ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "45e8a38f-ea38-487d-ab30-30ce947fb962", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
141462025-01-30T20:30:01.219ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
141472025-01-30T20:30:01.219ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
141482025-01-30T20:30:01.220ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8732c734-1c35-4c8e-934e-c007c0048479", "content-length": "691", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
141492025-01-30T20:30:01.220ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
141502025-01-30T20:30:01.220ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
141512025-01-30T20:30:01.220ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
141522025-01-30T20:30:01.220ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5664154-058a-468f-a8f8-e42c716e935d", "content-length": "682", "date": "Thu, 30 Jan 2025 20:30:00 GMT"} })
141532025-01-30T20:30:01.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141542025-01-30T20:30:01.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141552025-01-30T20:30:01.222ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 421.018666ms iteration = 27 status = {}
141562025-01-30T20:30:01.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141572025-01-30T20:30:01.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141582025-01-30T20:30:01.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141592025-01-30T20:30:01.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141602025-01-30T20:30:01.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141612025-01-30T20:30:01.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141622025-01-30T20:30:01.238ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 437.094692ms iteration = 26 status = {}
141632025-01-30T20:30:01.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7123eb93-01d5-4649-9db0-9de74664c1cb roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141642025-01-30T20:30:01.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7123eb93-01d5-4649-9db0-9de74664c1cb resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141652025-01-30T20:30:01.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 7123eb93-01d5-4649-9db0-9de74664c1cb response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141662025-01-30T20:30:02.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 521 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = a4e0c6df-ed98-4490-b23d-8d627b2a6e85 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
141672025-01-30T20:30:02.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fe71ec51-5ff5-451f-bb3e-c1986958607c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141682025-01-30T20:30:02.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fe71ec51-5ff5-451f-bb3e-c1986958607c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141692025-01-30T20:30:02.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = fe71ec51-5ff5-451f-bb3e-c1986958607c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141702025-01-30T20:30:03.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = da24d9a4-b326-46fc-8ee8-5d780b4fc5cc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141712025-01-30T20:30:03.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = da24d9a4-b326-46fc-8ee8-5d780b4fc5cc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141722025-01-30T20:30:03.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = da24d9a4-b326-46fc-8ee8-5d780b4fc5cc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141732025-01-30T20:30:04.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 741d98e4-d882-47c8-a5a3-be71266bc40b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141742025-01-30T20:30:04.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 741d98e4-d882-47c8-a5a3-be71266bc40b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141752025-01-30T20:30:04.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 741d98e4-d882-47c8-a5a3-be71266bc40b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141762025-01-30T20:30:05.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 88d622af-b2fc-4e43-88a3-c6ef393bde2a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141772025-01-30T20:30:05.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 88d622af-b2fc-4e43-88a3-c6ef393bde2a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141782025-01-30T20:30:05.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 88d622af-b2fc-4e43-88a3-c6ef393bde2a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141792025-01-30T20:30:06.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d2e08293-8cad-4dad-ac2e-a81f31fa02b4 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141802025-01-30T20:30:06.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d2e08293-8cad-4dad-ac2e-a81f31fa02b4 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141812025-01-30T20:30:06.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d2e08293-8cad-4dad-ac2e-a81f31fa02b4 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141822025-01-30T20:30:07.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6855d022-555c-4355-9917-85d9d9aaec1f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141832025-01-30T20:30:07.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6855d022-555c-4355-9917-85d9d9aaec1f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141842025-01-30T20:30:07.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6855d022-555c-4355-9917-85d9d9aaec1f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141852025-01-30T20:30:08.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1a756a8b-1d02-48a7-916d-4d37d2e84460 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141862025-01-30T20:30:08.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1a756a8b-1d02-48a7-916d-4d37d2e84460 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141872025-01-30T20:30:08.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1a756a8b-1d02-48a7-916d-4d37d2e84460 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141882025-01-30T20:30:09.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ddcb2ba4-a600-47e1-b21d-974bb00f250f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141892025-01-30T20:30:09.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ddcb2ba4-a600-47e1-b21d-974bb00f250f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141902025-01-30T20:30:09.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ddcb2ba4-a600-47e1-b21d-974bb00f250f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
141912025-01-30T20:30:10.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
141922025-01-30T20:30:10.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
141932025-01-30T20:30:10.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141942025-01-30T20:30:10.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141952025-01-30T20:30:10.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141962025-01-30T20:30:10.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141972025-01-30T20:30:10.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141982025-01-30T20:30:10.805ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141992025-01-30T20:30:10.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142002025-01-30T20:30:10.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
142012025-01-30T20:30:10.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142022025-01-30T20:30:10.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142032025-01-30T20:30:10.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142042025-01-30T20:30:10.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142052025-01-30T20:30:10.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142062025-01-30T20:30:10.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
142072025-01-30T20:30:10.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142082025-01-30T20:30:10.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142092025-01-30T20:30:10.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
142102025-01-30T20:30:10.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.136234ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
142112025-01-30T20:30:10.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.917316ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142122025-01-30T20:30:11.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 41ce05c0-2424-4ab8-8195-9ebf15e04d78 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142132025-01-30T20:30:11.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 41ce05c0-2424-4ab8-8195-9ebf15e04d78 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142142025-01-30T20:30:11.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 41ce05c0-2424-4ab8-8195-9ebf15e04d78 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142152025-01-30T20:30:12.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0f758b15-a2a7-4b17-994a-411c223f98b2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142162025-01-30T20:30:12.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0f758b15-a2a7-4b17-994a-411c223f98b2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142172025-01-30T20:30:12.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0f758b15-a2a7-4b17-994a-411c223f98b2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142182025-01-30T20:30:12.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 599 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = c238a233-7ab7-4758-b749-7b40a4000d2f response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
142192025-01-30T20:30:13.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ebb6329b-5511-4359-b63a-59d60f4c0a50 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142202025-01-30T20:30:13.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ebb6329b-5511-4359-b63a-59d60f4c0a50 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142212025-01-30T20:30:13.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ebb6329b-5511-4359-b63a-59d60f4c0a50 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142222025-01-30T20:30:14.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d3b4a0a1-5465-48b1-9b30-73b2c8ea6df0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142232025-01-30T20:30:14.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d3b4a0a1-5465-48b1-9b30-73b2c8ea6df0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142242025-01-30T20:30:14.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d3b4a0a1-5465-48b1-9b30-73b2c8ea6df0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142252025-01-30T20:30:15.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 66e07ac7-e0bc-4096-9667-a37c0ba954f2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142262025-01-30T20:30:15.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 66e07ac7-e0bc-4096-9667-a37c0ba954f2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142272025-01-30T20:30:15.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 66e07ac7-e0bc-4096-9667-a37c0ba954f2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142282025-01-30T20:30:16.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6f3df871-ec9a-418d-a828-540d34ff8200 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142292025-01-30T20:30:16.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6f3df871-ec9a-418d-a828-540d34ff8200 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142302025-01-30T20:30:16.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6f3df871-ec9a-418d-a828-540d34ff8200 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142312025-01-30T20:30:17.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ef81de03-e991-40db-9843-58cf859c6067 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142322025-01-30T20:30:17.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ef81de03-e991-40db-9843-58cf859c6067 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142332025-01-30T20:30:17.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ef81de03-e991-40db-9843-58cf859c6067 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142342025-01-30T20:30:18.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 919133f7-85f2-4b89-9971-1f02b301c18e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142352025-01-30T20:30:18.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 919133f7-85f2-4b89-9971-1f02b301c18e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142362025-01-30T20:30:18.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 919133f7-85f2-4b89-9971-1f02b301c18e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142372025-01-30T20:30:19.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5c311086-7464-4ea0-8a80-c3ba25c7035f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142382025-01-30T20:30:19.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5c311086-7464-4ea0-8a80-c3ba25c7035f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142392025-01-30T20:30:19.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5c311086-7464-4ea0-8a80-c3ba25c7035f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142402025-01-30T20:30:20.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 68b7c9ef-a6f9-4d96-b985-8edcc9c283b1 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142412025-01-30T20:30:20.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 68b7c9ef-a6f9-4d96-b985-8edcc9c283b1 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142422025-01-30T20:30:20.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 68b7c9ef-a6f9-4d96-b985-8edcc9c283b1 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142432025-01-30T20:30:20.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
142442025-01-30T20:30:20.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142452025-01-30T20:30:20.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
142462025-01-30T20:30:20.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142472025-01-30T20:30:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142482025-01-30T20:30:20.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142492025-01-30T20:30:20.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142502025-01-30T20:30:20.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142512025-01-30T20:30:20.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142522025-01-30T20:30:20.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.930129ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142532025-01-30T20:30:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
142542025-01-30T20:30:20.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142552025-01-30T20:30:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142562025-01-30T20:30:20.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142572025-01-30T20:30:20.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142582025-01-30T20:30:20.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142592025-01-30T20:30:20.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
142602025-01-30T20:30:20.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142612025-01-30T20:30:20.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142622025-01-30T20:30:20.821ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
142632025-01-30T20:30:20.821ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.17681ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
142642025-01-30T20:30:21.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f19d0133-16c5-4a31-b7b0-a5f8432f28c6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142652025-01-30T20:30:21.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f19d0133-16c5-4a31-b7b0-a5f8432f28c6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142662025-01-30T20:30:21.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f19d0133-16c5-4a31-b7b0-a5f8432f28c6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142672025-01-30T20:30:22.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5e668d25-7463-4cc3-96c0-9314259391f6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142682025-01-30T20:30:22.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5e668d25-7463-4cc3-96c0-9314259391f6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142692025-01-30T20:30:22.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5e668d25-7463-4cc3-96c0-9314259391f6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142702025-01-30T20:30:22.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 608 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = bb36e1c4-4ec7-441f-b131-d9134648dba1 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
142712025-01-30T20:30:23.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 213b827e-1d93-4cdb-9d41-37e399c7d320 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142722025-01-30T20:30:23.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 213b827e-1d93-4cdb-9d41-37e399c7d320 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142732025-01-30T20:30:23.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 213b827e-1d93-4cdb-9d41-37e399c7d320 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142742025-01-30T20:30:24.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5a7bab83-c224-471f-ad7c-877713b64035 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142752025-01-30T20:30:24.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5a7bab83-c224-471f-ad7c-877713b64035 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142762025-01-30T20:30:24.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5a7bab83-c224-471f-ad7c-877713b64035 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142772025-01-30T20:30:25.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 79439465-ad3a-4f36-83ae-812712f40820 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
142782025-01-30T20:30:25.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 79439465-ad3a-4f36-83ae-812712f40820 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
142792025-01-30T20:30:25.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 79439465-ad3a-4f36-83ae-812712f40820 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
142802025-01-30T20:30:25.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c2a5e1b7-a5dc-4d6e-bacb-85d3b1a41950 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142812025-01-30T20:30:25.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c2a5e1b7-a5dc-4d6e-bacb-85d3b1a41950 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142822025-01-30T20:30:25.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c2a5e1b7-a5dc-4d6e-bacb-85d3b1a41950 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142832025-01-30T20:30:26.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d52f2662-11ac-445c-aad2-6a713bfb7047 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142842025-01-30T20:30:26.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d52f2662-11ac-445c-aad2-6a713bfb7047 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142852025-01-30T20:30:26.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d52f2662-11ac-445c-aad2-6a713bfb7047 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142862025-01-30T20:30:27.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d959724a-f50d-4ebf-b2cd-5f9c195162d2 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142872025-01-30T20:30:27.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d959724a-f50d-4ebf-b2cd-5f9c195162d2 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142882025-01-30T20:30:27.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d959724a-f50d-4ebf-b2cd-5f9c195162d2 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142892025-01-30T20:30:28.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 64ac3163-0c74-410c-8c8f-9658c7e62ddc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142902025-01-30T20:30:28.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 64ac3163-0c74-410c-8c8f-9658c7e62ddc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142912025-01-30T20:30:28.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 64ac3163-0c74-410c-8c8f-9658c7e62ddc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142922025-01-30T20:30:29.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d455bdf1-834d-4bb4-918b-bf5259dfa802 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142932025-01-30T20:30:29.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d455bdf1-834d-4bb4-918b-bf5259dfa802 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142942025-01-30T20:30:29.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d455bdf1-834d-4bb4-918b-bf5259dfa802 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142952025-01-30T20:30:30.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6b0ae67b-5d7c-472e-8d78-d0d2b53ef91f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142962025-01-30T20:30:30.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6b0ae67b-5d7c-472e-8d78-d0d2b53ef91f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142972025-01-30T20:30:30.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 6b0ae67b-5d7c-472e-8d78-d0d2b53ef91f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
142982025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
142992025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
143002025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
143012025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143022025-01-30T20:30:30.802ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef
143032025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.57\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef"}
143042025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
143052025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
143062025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
143072025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
143082025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
143092025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
143102025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
143112025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
143122025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
143132025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
143142025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
143152025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
143162025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
143172025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
143182025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
143192025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
143202025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
143212025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
143222025-01-30T20:30:30.802ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
143232025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143242025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
143252025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
143262025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
143272025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
143282025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143292025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
143302025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
143312025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
143322025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
143332025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
143342025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
143352025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
143362025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
143372025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
143382025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
143392025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
143402025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143412025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
143422025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
143432025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
143442025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
143452025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
143462025-01-30T20:30:30.802ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
143472025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
143482025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
143492025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
143502025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
143512025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
143522025-01-30T20:30:30.802ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-30 20:20:30.802361996 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
143532025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
143542025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
143552025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
143562025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
143572025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
143582025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
143592025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
143602025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
143612025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
143622025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
143632025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143642025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
143652025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
143662025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
143672025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143682025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
143692025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
143702025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
143712025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
143722025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143732025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
143742025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
143752025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
143762025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
143772025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
143782025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143792025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
143802025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
143812025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
143822025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
143832025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
143842025-01-30T20:30:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0d657c89-e0f4-4d06-8add-9d38e7aaaf34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3e630c35-9e6f-4219-8e95-98b889a36f81.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("912f7b3b-f72d-4191-9a19-27e9c0d3675b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2982, tv_nsec: 12266458 } })
143852025-01-30T20:30:30.802ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b855967f-1c83-48e6-a52e-bc2e41c4ec2f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db149fee-69cf-48fe-8393-2d952566bed4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2982, tv_nsec: 12278228 } })
143862025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
143872025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
143882025-01-30T20:30:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
143892025-01-30T20:30:30.803ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
143902025-01-30T20:30:30.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.338797ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
143912025-01-30T20:30:30.803ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
143922025-01-30T20:30:30.803ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.255345ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
143932025-01-30T20:30:30.804ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143942025-01-30T20:30:30.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143952025-01-30T20:30:30.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143962025-01-30T20:30:30.805ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.740194ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
143972025-01-30T20:30:30.806ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.98113ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
143982025-01-30T20:30:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
143992025-01-30T20:30:30.806ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
144002025-01-30T20:30:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
144012025-01-30T20:30:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
144022025-01-30T20:30:30.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144032025-01-30T20:30:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144042025-01-30T20:30:30.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144052025-01-30T20:30:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
144062025-01-30T20:30:30.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144072025-01-30T20:30:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144082025-01-30T20:30:30.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
144092025-01-30T20:30:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
144102025-01-30T20:30:30.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
144112025-01-30T20:30:30.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144122025-01-30T20:30:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144132025-01-30T20:30:30.810ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
144142025-01-30T20:30:30.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
144152025-01-30T20:30:30.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144162025-01-30T20:30:30.811ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
144172025-01-30T20:30:30.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
144182025-01-30T20:30:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
144192025-01-30T20:30:30.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
144202025-01-30T20:30:30.813ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144212025-01-30T20:30:30.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
144222025-01-30T20:30:30.815ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2982, tv_nsec: 24417715 } })
144232025-01-30T20:30:30.815ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
144242025-01-30T20:30:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
144252025-01-30T20:30:30.815ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
144262025-01-30T20:30:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
144272025-01-30T20:30:30.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
144282025-01-30T20:30:30.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
144292025-01-30T20:30:30.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.197592ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
144302025-01-30T20:30:30.817ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144312025-01-30T20:30:30.818ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2982, tv_nsec: 27461089 } })
144322025-01-30T20:30:30.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
144332025-01-30T20:30:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
144342025-01-30T20:30:30.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
144352025-01-30T20:30:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
144362025-01-30T20:30:30.820ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
144372025-01-30T20:30:30.820ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
144382025-01-30T20:30:30.820ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.02462ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
144392025-01-30T20:30:30.821ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-30 20:20:30.802361996 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
144402025-01-30T20:30:30.821ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.764841ms iteration = 14 status = {"expiration":"2025-01-30T20:20:30.802361996Z","pruned":[]}
144412025-01-30T20:30:30.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144422025-01-30T20:30:30.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144432025-01-30T20:30:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144442025-01-30T20:30:30.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144452025-01-30T20:30:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144462025-01-30T20:30:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
144472025-01-30T20:30:30.827ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2982, tv_nsec: 36721577 } })
144482025-01-30T20:30:30.827ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
144492025-01-30T20:30:30.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144502025-01-30T20:30:30.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144512025-01-30T20:30:30.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
144522025-01-30T20:30:30.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
144532025-01-30T20:30:30.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144542025-01-30T20:30:30.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144552025-01-30T20:30:30.851ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
144562025-01-30T20:30:30.851ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
144572025-01-30T20:30:30.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
144582025-01-30T20:30:30.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
144592025-01-30T20:30:30.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144602025-01-30T20:30:30.860ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
144612025-01-30T20:30:30.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
144622025-01-30T20:30:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
144632025-01-30T20:30:30.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144642025-01-30T20:30:30.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
144652025-01-30T20:30:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
144662025-01-30T20:30:30.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
144672025-01-30T20:30:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
144682025-01-30T20:30:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
144692025-01-30T20:30:30.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
144702025-01-30T20:30:30.864ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
144712025-01-30T20:30:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
144722025-01-30T20:30:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
144732025-01-30T20:30:30.865ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
144742025-01-30T20:30:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
144752025-01-30T20:30:30.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144762025-01-30T20:30:30.867ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144772025-01-30T20:30:30.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
144782025-01-30T20:30:30.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
144792025-01-30T20:30:30.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
144802025-01-30T20:30:30.870ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
144812025-01-30T20:30:30.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
144822025-01-30T20:30:30.870ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
144832025-01-30T20:30:30.870ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.176752ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
144842025-01-30T20:30:30.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
144852025-01-30T20:30:30.870ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
144862025-01-30T20:30:30.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
144872025-01-30T20:30:30.872ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
144882025-01-30T20:30:30.872ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
144892025-01-30T20:30:30.872ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.084555ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
144902025-01-30T20:30:30.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
144912025-01-30T20:30:30.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
144922025-01-30T20:30:30.876ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
144932025-01-30T20:30:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
144942025-01-30T20:30:30.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.426493ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
144952025-01-30T20:30:30.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144962025-01-30T20:30:30.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
144972025-01-30T20:30:30.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144982025-01-30T20:30:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144992025-01-30T20:30:30.883ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
145002025-01-30T20:30:30.883ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
145012025-01-30T20:30:30.883ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
145022025-01-30T20:30:30.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
145032025-01-30T20:30:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
145042025-01-30T20:30:30.885ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145052025-01-30T20:30:30.887ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145062025-01-30T20:30:30.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
145072025-01-30T20:30:30.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
145082025-01-30T20:30:30.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
145092025-01-30T20:30:30.889ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
145102025-01-30T20:30:30.889ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.163359ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
145112025-01-30T20:30:30.890ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
145122025-01-30T20:30:30.890ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 0 version = 2
145132025-01-30T20:30:30.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
145142025-01-30T20:30:30.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
145152025-01-30T20:30:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
145162025-01-30T20:30:30.891ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
145172025-01-30T20:30:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
145182025-01-30T20:30:30.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145192025-01-30T20:30:30.895ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
145202025-01-30T20:30:30.895ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
145212025-01-30T20:30:30.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
145222025-01-30T20:30:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
145232025-01-30T20:30:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
145242025-01-30T20:30:30.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
145252025-01-30T20:30:30.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145262025-01-30T20:30:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
145272025-01-30T20:30:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145282025-01-30T20:30:30.898ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ab6d0764-4e0c-4906-8e50-b3f758249277 dns_zone_name = oxide.test found_so_far = 1 version = 2
145292025-01-30T20:30:30.898ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
145302025-01-30T20:30:30.898ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-30 20:18:13.133071 UTC dns_group = external generation = 2
145312025-01-30T20:30:30.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 96.415476ms iteration = 14 status = {"generation":2}
145322025-01-30T20:30:30.898ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
145332025-01-30T20:30:30.898ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
145342025-01-30T20:30:30.898ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
145352025-01-30T20:30:30.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
145362025-01-30T20:30:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
145372025-01-30T20:30:30.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145382025-01-30T20:30:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145392025-01-30T20:30:30.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145402025-01-30T20:30:30.900ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 98.72681ms iteration = 30 status = {"physical_disks_added":0}
145412025-01-30T20:30:30.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145422025-01-30T20:30:30.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
145432025-01-30T20:30:30.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
145442025-01-30T20:30:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
145452025-01-30T20:30:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
145462025-01-30T20:30:30.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145472025-01-30T20:30:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
145482025-01-30T20:30:30.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.401922ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
145492025-01-30T20:30:30.906ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
145502025-01-30T20:30:30.906ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
145512025-01-30T20:30:30.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
145522025-01-30T20:30:30.906ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.100659ms iteration = 27 status = 0
145532025-01-30T20:30:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
145542025-01-30T20:30:30.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
145552025-01-30T20:30:30.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 105.620822ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
145562025-01-30T20:30:30.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
145572025-01-30T20:30:30.909ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145582025-01-30T20:30:30.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.497352ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
145592025-01-30T20:30:30.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
145602025-01-30T20:30:30.910ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
145612025-01-30T20:30:30.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
145622025-01-30T20:30:30.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.992325ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
145632025-01-30T20:30:30.913ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
145642025-01-30T20:30:30.913ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 111.839224ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
145652025-01-30T20:30:30.924ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
145662025-01-30T20:30:30.925ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
145672025-01-30T20:30:30.925ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
145682025-01-30T20:30:30.925ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.907168ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
145692025-01-30T20:30:30.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145702025-01-30T20:30:30.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
145712025-01-30T20:30:30.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
145722025-01-30T20:30:30.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
145732025-01-30T20:30:30.943ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f6c4f216-2d26-4354-aeac-bcff458c8e02 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
145742025-01-30T20:30:30.943ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
145752025-01-30T20:30:30.943ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-30 20:18:12.536035 UTC dns_group = internal generation = 1
145762025-01-30T20:30:30.943ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 141.009874ms iteration = 14 status = {"generation":1}
145772025-01-30T20:30:30.951ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-30T20:17:27.266699Z, time_modified: 2025-01-30T20:17:27.266699Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9bc122de-f506-4c6d-8101-a7727b3ad959, db_silo: Silo { identity: SiloIdentity { id: 9bc122de-f506-4c6d-8101-a7727b3ad959, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-30T20:18:13.073208Z, time_modified: 2025-01-30T20:18:13.073208Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a" }] }) }
145782025-01-30T20:30:30.951ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 148.900373ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]}},"default_endpoint":{"silo_id":"9bc122de-f506-4c6d-8101-a7727b3ad959","tls_certs":["2e8ccc81f614887e37ba06feeec02108b14f5ee3c605309ed036e2d258cd7a4a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
145792025-01-30T20:30:30.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
145802025-01-30T20:30:30.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
145812025-01-30T20:30:30.955ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
145822025-01-30T20:30:30.956ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
145832025-01-30T20:30:30.956ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 154.395015ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
145842025-01-30T20:30:30.961ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
145852025-01-30T20:30:30.961ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
145862025-01-30T20:30:30.961ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3990f994-8ca5-40d3-b36c-5a67962fcac2", "content-length": "26", "date": "Thu, 30 Jan 2025 20:30:30 GMT"} })
145872025-01-30T20:30:30.961ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
145882025-01-30T20:30:30.961ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
145892025-01-30T20:30:30.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
145902025-01-30T20:30:30.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
145912025-01-30T20:30:30.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145922025-01-30T20:30:30.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
145932025-01-30T20:30:30.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
145942025-01-30T20:30:30.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
145952025-01-30T20:30:30.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145962025-01-30T20:30:31.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
145972025-01-30T20:30:31.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
145982025-01-30T20:30:31.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
145992025-01-30T20:30:31.101ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
146002025-01-30T20:30:31.101ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "44f97589-4cdb-48c4-98dc-bdb4c59d9d3d", "date": "Thu, 30 Jan 2025 20:30:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
146012025-01-30T20:30:31.101ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
146022025-01-30T20:30:31.102ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
146032025-01-30T20:30:31.102ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
146042025-01-30T20:30:31.103ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff6e1130-3e9b-4a81-a608-805b4ecafc3d", "content-length": "26", "date": "Thu, 30 Jan 2025 20:30:30 GMT"} })
146052025-01-30T20:30:31.103ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
146062025-01-30T20:30:31.104ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ec0fd4be-7b75-42c2-8a0b-c26601de7cb9", "date": "Thu, 30 Jan 2025 20:30:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
146072025-01-30T20:30:31.104ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
146082025-01-30T20:30:31.108ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
146092025-01-30T20:30:31.109ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
146102025-01-30T20:30:31.109ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 306.826366ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
146112025-01-30T20:30:31.128ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
146122025-01-30T20:30:31.128ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
146132025-01-30T20:30:31.128ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6977ee65-3cfc-44e6-bd6f-384f1c22b0ae", "content-length": "372", "date": "Thu, 30 Jan 2025 20:30:31 GMT"} })
146142025-01-30T20:30:31.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146152025-01-30T20:30:31.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146162025-01-30T20:30:31.131ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
146172025-01-30T20:30:31.131ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
146182025-01-30T20:30:31.132ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "008b8d04-5ba4-44ce-bdeb-83a415a02a65", "content-length": "26", "date": "Thu, 30 Jan 2025 20:30:30 GMT"} })
146192025-01-30T20:30:31.132ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
146202025-01-30T20:30:31.134ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
146212025-01-30T20:30:31.150ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
146222025-01-30T20:30:31.150ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
146232025-01-30T20:30:31.150ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a2938527-e058-4978-b024-67f2456b1fb5", "date": "Thu, 30 Jan 2025 20:30:31 GMT"} })
146242025-01-30T20:30:31.150ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146252025-01-30T20:30:31.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146262025-01-30T20:30:31.151ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
146272025-01-30T20:30:31.154ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146282025-01-30T20:30:31.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146292025-01-30T20:30:31.165ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
146302025-01-30T20:30:31.166ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5366af2c-f45d-4228-8cff-c6cc12fd7dad", "content-length": "2", "date": "Thu, 30 Jan 2025 20:30:30 GMT"} })
146312025-01-30T20:30:31.167ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
146322025-01-30T20:30:31.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
146332025-01-30T20:30:31.223ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
146342025-01-30T20:30:31.224ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e73f74f7-f222-43e9-8790-a062e2731d79", "content-length": "691", "date": "Thu, 30 Jan 2025 20:30:31 GMT"} })
146352025-01-30T20:30:31.224ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
146362025-01-30T20:30:31.224ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
146372025-01-30T20:30:31.224ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
146382025-01-30T20:30:31.225ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 423.256957ms iteration = 28 status = {}
146392025-01-30T20:30:31.226ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 424.202063ms iteration = 27 status = null
146402025-01-30T20:30:31.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146412025-01-30T20:30:31.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146422025-01-30T20:30:31.234ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
146432025-01-30T20:30:31.234ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
146442025-01-30T20:30:31.235ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6c0f20a1-b6f9-4428-8e76-f2373c68ffe7", "date": "Thu, 30 Jan 2025 20:30:31 GMT"} })
146452025-01-30T20:30:31.237ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 435.445146ms iteration = 28 status = {}
146462025-01-30T20:30:31.279ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
146472025-01-30T20:30:31.280ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "56db86d4-1e12-481e-803c-b4287bc68c5d", "date": "Thu, 30 Jan 2025 20:30:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
146482025-01-30T20:30:31.280ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
146492025-01-30T20:30:31.282ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fede7c37-ab7f-426a-9bdf-a346089fe57d", "date": "Thu, 30 Jan 2025 20:30:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
146502025-01-30T20:30:31.282ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
146512025-01-30T20:30:31.284ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 481.960047ms iteration = 27 status = {}
146522025-01-30T20:30:31.285ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2d92c0b4-7ab0-4279-8eff-5cbfd6ddf7cd", "date": "Thu, 30 Jan 2025 20:30:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
146532025-01-30T20:30:31.285ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
146542025-01-30T20:30:31.289ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
146552025-01-30T20:30:31.289ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 487.599963ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
146562025-01-30T20:30:31.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146572025-01-30T20:30:31.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146582025-01-30T20:30:31.377ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
146592025-01-30T20:30:31.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146602025-01-30T20:30:31.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146612025-01-30T20:30:31.388ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
146622025-01-30T20:30:31.389ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "33042451-60fb-48c1-b1d7-65dcd4862011", "content-length": "134", "date": "Thu, 30 Jan 2025 20:30:30 GMT"} })
146632025-01-30T20:30:31.389ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
146642025-01-30T20:30:31.389ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
146652025-01-30T20:30:31.389ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
146662025-01-30T20:30:31.389ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
146672025-01-30T20:30:31.389ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
146682025-01-30T20:30:31.389ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
146692025-01-30T20:30:31.389ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
146702025-01-30T20:30:31.389ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
146712025-01-30T20:30:31.389ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
146722025-01-30T20:30:31.389ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
146732025-01-30T20:30:31.390ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
146742025-01-30T20:30:31.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146752025-01-30T20:30:31.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146762025-01-30T20:30:31.393ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
146772025-01-30T20:30:31.393ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "04c481d7-0d42-494a-94e4-cd9632d81d70", "content-length": "2", "date": "Thu, 30 Jan 2025 20:30:30 GMT"} })
146782025-01-30T20:30:31.393ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
146792025-01-30T20:30:31.393ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2077c2db-73d3-4f5a-b080-9783d359ff15", "content-length": "52", "date": "Thu, 30 Jan 2025 20:30:30 GMT"} })
146802025-01-30T20:30:31.393ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
146812025-01-30T20:30:31.393ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
146822025-01-30T20:30:31.489ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b2f3d7c2-6657-4811-b941-0f5f7ecd5ea5", "date": "Thu, 30 Jan 2025 20:30:31 GMT"} })
146832025-01-30T20:30:31.489ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
146842025-01-30T20:30:31.489ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
146852025-01-30T20:30:31.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 75fc407f-48b3-4d42-8ad4-782074bacca3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
146862025-01-30T20:30:31.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 75fc407f-48b3-4d42-8ad4-782074bacca3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
146872025-01-30T20:30:31.489ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "22530aca-05cc-4416-97db-d1b1fa7e0b0d", "content-length": "682", "date": "Thu, 30 Jan 2025 20:30:31 GMT"} })
146882025-01-30T20:30:31.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146892025-01-30T20:30:31.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146902025-01-30T20:30:31.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 75fc407f-48b3-4d42-8ad4-782074bacca3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
146912025-01-30T20:30:31.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146922025-01-30T20:30:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146932025-01-30T20:30:31.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146942025-01-30T20:30:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146952025-01-30T20:30:31.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146962025-01-30T20:30:31.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146972025-01-30T20:30:31.508ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 706.059546ms iteration = 27 status = {}
146982025-01-30T20:30:32.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 522 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 7dfb175e-316f-498e-b656-245d312fd0d7 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
146992025-01-30T20:30:32.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b8fc813c-c339-4f02-a7e2-c7182af20e60 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147002025-01-30T20:30:32.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b8fc813c-c339-4f02-a7e2-c7182af20e60 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147012025-01-30T20:30:32.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b8fc813c-c339-4f02-a7e2-c7182af20e60 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147022025-01-30T20:30:33.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0e1d88f1-df32-43cd-ba1b-88c62a34b834 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147032025-01-30T20:30:33.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0e1d88f1-df32-43cd-ba1b-88c62a34b834 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147042025-01-30T20:30:33.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0e1d88f1-df32-43cd-ba1b-88c62a34b834 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147052025-01-30T20:30:34.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 24f4ef68-e082-400a-a5ad-92a223c42689 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147062025-01-30T20:30:34.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 24f4ef68-e082-400a-a5ad-92a223c42689 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147072025-01-30T20:30:34.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 24f4ef68-e082-400a-a5ad-92a223c42689 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147082025-01-30T20:30:35.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 00c633af-2f37-4a3c-8ec2-12070ec23631 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147092025-01-30T20:30:35.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 00c633af-2f37-4a3c-8ec2-12070ec23631 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147102025-01-30T20:30:35.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 00c633af-2f37-4a3c-8ec2-12070ec23631 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147112025-01-30T20:30:36.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df2a064f-6cd3-40b6-a9ea-87b0668d4187 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147122025-01-30T20:30:36.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df2a064f-6cd3-40b6-a9ea-87b0668d4187 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147132025-01-30T20:30:36.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df2a064f-6cd3-40b6-a9ea-87b0668d4187 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147142025-01-30T20:30:37.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 05d237b7-6d63-4a5b-80d4-4cef152c5017 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147152025-01-30T20:30:37.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 05d237b7-6d63-4a5b-80d4-4cef152c5017 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147162025-01-30T20:30:37.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 05d237b7-6d63-4a5b-80d4-4cef152c5017 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147172025-01-30T20:30:38.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31cd2365-95c8-4d22-981f-4648beaeff8d roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147182025-01-30T20:30:38.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31cd2365-95c8-4d22-981f-4648beaeff8d resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147192025-01-30T20:30:38.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 31cd2365-95c8-4d22-981f-4648beaeff8d response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147202025-01-30T20:30:39.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ca68808f-676d-489d-86ff-b234cd325767 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147212025-01-30T20:30:39.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ca68808f-676d-489d-86ff-b234cd325767 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147222025-01-30T20:30:39.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ca68808f-676d-489d-86ff-b234cd325767 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147232025-01-30T20:30:40.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 40071c64-8995-4ef1-b734-6a16e0ef174e roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147242025-01-30T20:30:40.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 40071c64-8995-4ef1-b734-6a16e0ef174e resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147252025-01-30T20:30:40.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 40071c64-8995-4ef1-b734-6a16e0ef174e response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147262025-01-30T20:30:40.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
147272025-01-30T20:30:40.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
147282025-01-30T20:30:40.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
147292025-01-30T20:30:40.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147302025-01-30T20:30:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147312025-01-30T20:30:40.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
147322025-01-30T20:30:40.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147332025-01-30T20:30:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
147342025-01-30T20:30:40.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147352025-01-30T20:30:40.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147362025-01-30T20:30:40.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147372025-01-30T20:30:40.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147382025-01-30T20:30:40.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147392025-01-30T20:30:40.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
147402025-01-30T20:30:40.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147412025-01-30T20:30:40.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147422025-01-30T20:30:40.825ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
147432025-01-30T20:30:40.825ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.710098ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
147442025-01-30T20:30:40.829ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
147452025-01-30T20:30:40.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
147462025-01-30T20:30:40.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.157578ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
147472025-01-30T20:30:41.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df94fdcc-8278-4dcb-a9d0-e04e72af37ff roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147482025-01-30T20:30:41.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df94fdcc-8278-4dcb-a9d0-e04e72af37ff resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147492025-01-30T20:30:41.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = df94fdcc-8278-4dcb-a9d0-e04e72af37ff response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147502025-01-30T20:30:42.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 528 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 9ff10762-d867-4575-a5b4-92b23a3014db response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
147512025-01-30T20:30:42.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 521c126d-c1df-493f-a885-a4163dd79dc9 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147522025-01-30T20:30:42.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 521c126d-c1df-493f-a885-a4163dd79dc9 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147532025-01-30T20:30:42.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 521c126d-c1df-493f-a885-a4163dd79dc9 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147542025-01-30T20:30:43.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a3d4ecfc-caec-48b3-b16b-53aed5fdccfc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147552025-01-30T20:30:43.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a3d4ecfc-caec-48b3-b16b-53aed5fdccfc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147562025-01-30T20:30:43.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a3d4ecfc-caec-48b3-b16b-53aed5fdccfc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147572025-01-30T20:30:44.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4c0b6537-7de7-4fc3-a9bc-ad4a9f8a4692 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147582025-01-30T20:30:44.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4c0b6537-7de7-4fc3-a9bc-ad4a9f8a4692 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147592025-01-30T20:30:44.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 4c0b6537-7de7-4fc3-a9bc-ad4a9f8a4692 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147602025-01-30T20:30:45.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 15bc7de8-7df1-4ca8-b88c-65f081ab97a0 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147612025-01-30T20:30:45.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 15bc7de8-7df1-4ca8-b88c-65f081ab97a0 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147622025-01-30T20:30:45.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 15bc7de8-7df1-4ca8-b88c-65f081ab97a0 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147632025-01-30T20:30:46.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 02875345-ac44-4ee0-8cec-f3e2fb43b517 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147642025-01-30T20:30:46.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 02875345-ac44-4ee0-8cec-f3e2fb43b517 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147652025-01-30T20:30:46.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 02875345-ac44-4ee0-8cec-f3e2fb43b517 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147662025-01-30T20:30:47.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 854ccb5f-bfc0-4457-a70c-2ecf14626911 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147672025-01-30T20:30:47.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 854ccb5f-bfc0-4457-a70c-2ecf14626911 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147682025-01-30T20:30:47.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 854ccb5f-bfc0-4457-a70c-2ecf14626911 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147692025-01-30T20:30:48.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9d196960-5a1e-4567-9f85-ed6c1e20bfbc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147702025-01-30T20:30:48.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9d196960-5a1e-4567-9f85-ed6c1e20bfbc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147712025-01-30T20:30:48.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9d196960-5a1e-4567-9f85-ed6c1e20bfbc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147722025-01-30T20:30:49.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b874bae9-1307-4aa6-a0e1-748c2bcab6c3 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147732025-01-30T20:30:49.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b874bae9-1307-4aa6-a0e1-748c2bcab6c3 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147742025-01-30T20:30:49.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = b874bae9-1307-4aa6-a0e1-748c2bcab6c3 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147752025-01-30T20:30:50.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
147762025-01-30T20:30:50.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
147772025-01-30T20:30:50.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
147782025-01-30T20:30:50.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147792025-01-30T20:30:50.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147802025-01-30T20:30:50.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
147812025-01-30T20:30:50.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147822025-01-30T20:30:50.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
147832025-01-30T20:30:50.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
147842025-01-30T20:30:50.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.65993ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
147852025-01-30T20:30:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
147862025-01-30T20:30:50.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147872025-01-30T20:30:50.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147882025-01-30T20:30:50.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147892025-01-30T20:30:50.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147902025-01-30T20:30:50.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147912025-01-30T20:30:50.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
147922025-01-30T20:30:50.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147932025-01-30T20:30:50.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147942025-01-30T20:30:50.828ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
147952025-01-30T20:30:50.828ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.928558ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
147962025-01-30T20:30:50.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c9db8cac-32d8-4e72-a144-dd6566b39e25 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147972025-01-30T20:30:50.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c9db8cac-32d8-4e72-a144-dd6566b39e25 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147982025-01-30T20:30:50.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c9db8cac-32d8-4e72-a144-dd6566b39e25 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
147992025-01-30T20:30:51.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ceb9f675-c000-4390-938c-7af2c8c82d86 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148002025-01-30T20:30:51.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ceb9f675-c000-4390-938c-7af2c8c82d86 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148012025-01-30T20:30:51.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = ceb9f675-c000-4390-938c-7af2c8c82d86 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148022025-01-30T20:30:52.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 654 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 9f36f4e3-4e32-4c1b-884c-0d91f2c88d98 response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
148032025-01-30T20:30:52.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = eee8d2c3-c538-4b74-b504-b5c3808d7ecd roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148042025-01-30T20:30:52.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = eee8d2c3-c538-4b74-b504-b5c3808d7ecd resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148052025-01-30T20:30:52.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = eee8d2c3-c538-4b74-b504-b5c3808d7ecd response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148062025-01-30T20:30:53.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3e64437c-2f8a-4c67-b92d-342a2552072c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148072025-01-30T20:30:53.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3e64437c-2f8a-4c67-b92d-342a2552072c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148082025-01-30T20:30:53.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 3e64437c-2f8a-4c67-b92d-342a2552072c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148092025-01-30T20:30:55.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5982f55d-a1d7-401e-9aa0-2fad2df0aff7 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148102025-01-30T20:30:55.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5982f55d-a1d7-401e-9aa0-2fad2df0aff7 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148112025-01-30T20:30:55.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5982f55d-a1d7-401e-9aa0-2fad2df0aff7 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148122025-01-30T20:30:55.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 64e5b720-3610-4f41-908a-3047d17ed6d5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
148132025-01-30T20:30:55.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 64e5b720-3610-4f41-908a-3047d17ed6d5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
148142025-01-30T20:30:55.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41944 req_id = 64e5b720-3610-4f41-908a-3047d17ed6d5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
148152025-01-30T20:30:56.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 54898955-7946-4a37-a066-f17e4cad4e23 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148162025-01-30T20:30:56.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 54898955-7946-4a37-a066-f17e4cad4e23 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148172025-01-30T20:30:56.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 54898955-7946-4a37-a066-f17e4cad4e23 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148182025-01-30T20:30:57.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c243f2a6-c397-4ab2-894d-2d67fb8bda74 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148192025-01-30T20:30:57.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c243f2a6-c397-4ab2-894d-2d67fb8bda74 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148202025-01-30T20:30:57.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = c243f2a6-c397-4ab2-894d-2d67fb8bda74 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148212025-01-30T20:30:58.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 06a75925-b6c9-4b1a-9ce2-367b6bccee00 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148222025-01-30T20:30:58.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 06a75925-b6c9-4b1a-9ce2-367b6bccee00 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148232025-01-30T20:30:58.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 06a75925-b6c9-4b1a-9ce2-367b6bccee00 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148242025-01-30T20:30:59.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1562b9bd-6703-4feb-9054-cd47acfb1133 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148252025-01-30T20:30:59.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1562b9bd-6703-4feb-9054-cd47acfb1133 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148262025-01-30T20:30:59.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 1562b9bd-6703-4feb-9054-cd47acfb1133 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148272025-01-30T20:31:00.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9df8f019-da28-4f51-b44d-f60b3004ae8b roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148282025-01-30T20:31:00.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9df8f019-da28-4f51-b44d-f60b3004ae8b resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148292025-01-30T20:31:00.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 9df8f019-da28-4f51-b44d-f60b3004ae8b response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
148302025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
148312025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
148322025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
148332025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148342025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
148352025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
148362025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
148372025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
148382025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
148392025-01-30T20:31:00.802ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
148402025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
148412025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
148422025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148432025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
148442025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
148452025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
148462025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
148472025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
148482025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
148492025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
148502025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
148512025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
148522025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
148532025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
148542025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
148552025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
148562025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
148572025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
148582025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
148592025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
148602025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148612025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
148622025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
148632025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
148642025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
148652025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
148662025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
148672025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
148682025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148692025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
148702025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
148712025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
148722025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
148732025-01-30T20:31:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
148742025-01-30T20:31:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148752025-01-30T20:31:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
148762025-01-30T20:31:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148772025-01-30T20:31:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
148782025-01-30T20:31:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
148792025-01-30T20:31:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
148802025-01-30T20:31:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
148812025-01-30T20:31:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
148822025-01-30T20:31:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
148832025-01-30T20:31:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
148842025-01-30T20:31:00.805ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.010124ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
148852025-01-30T20:31:00.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148862025-01-30T20:31:00.806ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148872025-01-30T20:31:00.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148882025-01-30T20:31:00.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3012, tv_nsec: 15971421 } })
148892025-01-30T20:31:00.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
148902025-01-30T20:31:00.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148912025-01-30T20:31:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
148922025-01-30T20:31:00.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148932025-01-30T20:31:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
148942025-01-30T20:31:00.809ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
148952025-01-30T20:31:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148962025-01-30T20:31:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
148972025-01-30T20:31:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
148982025-01-30T20:31:00.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
148992025-01-30T20:31:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
149002025-01-30T20:31:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
149012025-01-30T20:31:00.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
149022025-01-30T20:31:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
149032025-01-30T20:31:00.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149042025-01-30T20:31:00.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149052025-01-30T20:31:00.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149062025-01-30T20:31:00.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
149072025-01-30T20:31:00.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149082025-01-30T20:31:00.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
149092025-01-30T20:31:00.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
149102025-01-30T20:31:00.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149112025-01-30T20:31:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
149122025-01-30T20:31:00.814ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
149132025-01-30T20:31:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
149142025-01-30T20:31:00.815ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
149152025-01-30T20:31:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
149162025-01-30T20:31:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
149172025-01-30T20:31:00.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
149182025-01-30T20:31:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
149192025-01-30T20:31:00.817ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3012, tv_nsec: 26387550 } })
149202025-01-30T20:31:00.817ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
149212025-01-30T20:31:00.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149222025-01-30T20:31:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149232025-01-30T20:31:00.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
149242025-01-30T20:31:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
149252025-01-30T20:31:00.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149262025-01-30T20:31:00.820ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-80be2cf5-c1f1-42e5-8353-289dd0bb621a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3012, tv_nsec: 30125483 } })
149272025-01-30T20:31:00.821ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
149282025-01-30T20:31:00.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
149292025-01-30T20:31:00.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
149302025-01-30T20:31:00.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
149312025-01-30T20:31:00.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
149322025-01-30T20:31:00.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
149332025-01-30T20:31:00.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
149342025-01-30T20:31:00.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
149352025-01-30T20:31:00.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
149362025-01-30T20:31:00.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
149372025-01-30T20:31:00.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
149382025-01-30T20:31:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
149392025-01-30T20:31:00.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 48.957318ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
149402025-01-30T20:31:00.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
149412025-01-30T20:31:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
149422025-01-30T20:31:00.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.778079ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
149432025-01-30T20:31:00.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.172819ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
149442025-01-30T20:31:00.859ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
149452025-01-30T20:31:00.859ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
149462025-01-30T20:31:00.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
149472025-01-30T20:31:00.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
149482025-01-30T20:31:00.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
149492025-01-30T20:31:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
149502025-01-30T20:31:00.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149512025-01-30T20:31:00.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149522025-01-30T20:31:00.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
149532025-01-30T20:31:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
149542025-01-30T20:31:00.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.399194ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
149552025-01-30T20:31:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
149562025-01-30T20:31:00.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
149572025-01-30T20:31:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
149582025-01-30T20:31:00.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149592025-01-30T20:31:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
149602025-01-30T20:31:00.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149612025-01-30T20:31:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149622025-01-30T20:31:00.866ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
149632025-01-30T20:31:00.866ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.083149ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
149642025-01-30T20:31:00.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.061348ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
149652025-01-30T20:31:00.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
149662025-01-30T20:31:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
149672025-01-30T20:31:00.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 80be2cf5-c1f1-42e5-8353-289dd0bb621a, lookup_type: ById(80be2cf5-c1f1-42e5-8353-289dd0bb621a) } result = Ok(())
149682025-01-30T20:31:00.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
149692025-01-30T20:31:00.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
149702025-01-30T20:31:00.870ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 68.272425ms iteration = 28 status = 0
149712025-01-30T20:31:00.881ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
149722025-01-30T20:31:00.881ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.590879ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
149732025-01-30T20:31:00.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 83.255151ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
149742025-01-30T20:31:00.893ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149752025-01-30T20:31:00.894ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
149762025-01-30T20:31:00.894ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
149772025-01-30T20:31:00.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
149782025-01-30T20:31:00.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
149792025-01-30T20:31:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
149802025-01-30T20:31:00.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
149812025-01-30T20:31:00.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
149822025-01-30T20:31:00.924ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
149832025-01-30T20:31:00.924ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
149842025-01-30T20:31:00.924ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.973835ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
149852025-01-30T20:31:00.938ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f zone_address = fd00:1122:3344:101::2
149862025-01-30T20:31:00.938ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
149872025-01-30T20:31:00.938ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fa480a3-cffa-427b-9d1c-fd598d53c49b", "content-length": "26", "date": "Thu, 30 Jan 2025 20:31:00 GMT"} })
149882025-01-30T20:31:00.938ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
149892025-01-30T20:31:00.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
149902025-01-30T20:31:00.965ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 162.914172ms iteration = 31 status = {"physical_disks_added":0}
149912025-01-30T20:31:00.967ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
149922025-01-30T20:31:00.967ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
149932025-01-30T20:31:00.967ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "27ba3efc-4adb-4a98-9c52-c31816d7640d", "content-length": "26", "date": "Thu, 30 Jan 2025 20:31:00 GMT"} })
149942025-01-30T20:31:00.967ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
149952025-01-30T20:31:00.969ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
149962025-01-30T20:31:00.970ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
149972025-01-30T20:31:00.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
149982025-01-30T20:31:01.011ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
149992025-01-30T20:31:01.011ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
150002025-01-30T20:31:01.011ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc4b3d75-dd00-48cd-abd8-b6d6eaf67efd", "content-length": "372", "date": "Thu, 30 Jan 2025 20:31:01 GMT"} })
150012025-01-30T20:31:01.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
150022025-01-30T20:31:01.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
150032025-01-30T20:31:01.012ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
150042025-01-30T20:31:01.012ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
150052025-01-30T20:31:01.013ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "01466f35-7a95-48de-a16f-bc94da925da7", "content-length": "26", "date": "Thu, 30 Jan 2025 20:31:00 GMT"} })
150062025-01-30T20:31:01.013ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
150072025-01-30T20:31:01.013ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
150082025-01-30T20:31:01.013ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 211.12399ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
150092025-01-30T20:31:01.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150102025-01-30T20:31:01.014ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
150112025-01-30T20:31:01.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
150122025-01-30T20:31:01.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
150132025-01-30T20:31:01.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
150142025-01-30T20:31:01.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
150152025-01-30T20:31:01.050ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
150162025-01-30T20:31:01.050ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
150172025-01-30T20:31:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
150182025-01-30T20:31:01.060ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
150192025-01-30T20:31:01.060ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
150202025-01-30T20:31:01.060ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4e855865-33a5-4dfd-96bb-53522fcd56cb", "date": "Thu, 30 Jan 2025 20:31:01 GMT"} })
150212025-01-30T20:31:01.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
150222025-01-30T20:31:01.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
150232025-01-30T20:31:01.063ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
150242025-01-30T20:31:01.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
150252025-01-30T20:31:01.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
150262025-01-30T20:31:01.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
150272025-01-30T20:31:01.069ZINFOnexus (BackgroundTasks): VPC route manager sled 80be2cf5-c1f1-42e5-8353-289dd0bb621a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
150282025-01-30T20:31:01.069ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
150292025-01-30T20:31:01.069ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0375929c-0f91-4915-b789-87230a624a7e", "date": "Thu, 30 Jan 2025 20:31:01 GMT"} })
150302025-01-30T20:31:01.071ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 269.272474ms iteration = 29 status = {}
150312025-01-30T20:31:01.073ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 271.391422ms iteration = 28 status = {}
150322025-01-30T20:31:01.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 24af1a1c-2ab3-4855-9323-415cb33d3eea roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
150332025-01-30T20:31:01.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 24af1a1c-2ab3-4855-9323-415cb33d3eea resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
150342025-01-30T20:31:01.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 24af1a1c-2ab3-4855-9323-415cb33d3eea response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
150352025-01-30T20:31:01.189ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
150362025-01-30T20:31:01.190ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8963ac9f-e428-4c4d-bc18-8f9f2d0543d4", "content-length": "2", "date": "Thu, 30 Jan 2025 20:31:00 GMT"} })
150372025-01-30T20:31:01.192ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
150382025-01-30T20:31:01.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
150392025-01-30T20:31:01.194ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 392.164585ms iteration = 28 status = null
150402025-01-30T20:31:01.197ZDEBGnexus (BackgroundTasks): client request SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
150412025-01-30T20:31:01.198ZDEBGnexus (BackgroundTasks): client response SledAgent = 80be2cf5-c1f1-42e5-8353-289dd0bb621a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "720b3f61-34d8-461b-8cf3-8b795f6f341b", "content-length": "691", "date": "Thu, 30 Jan 2025 20:31:01 GMT"} })
150422025-01-30T20:31:01.198ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
150432025-01-30T20:31:01.198ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
150442025-01-30T20:31:01.198ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
150452025-01-30T20:31:01.201ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 399.140158ms iteration = 29 status = {}
150462025-01-30T20:31:01.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
150472025-01-30T20:31:01.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
150482025-01-30T20:31:01.241ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66f0aa34-763f-4573-a807-c09423e72489, rack_id: 6cd2152b-e0e7-4208-8446-3b1ba878a49f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(be6f557f-d8b4-40a3-b0d5-7cfb45f2354e) } rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
150492025-01-30T20:31:01.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
150502025-01-30T20:31:01.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
150512025-01-30T20:31:01.253ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
150522025-01-30T20:31:01.254ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7fd6e3d-bab6-48dc-b288-c49ff1dab55f", "content-length": "134", "date": "Thu, 30 Jan 2025 20:31:00 GMT"} })
150532025-01-30T20:31:01.254ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
150542025-01-30T20:31:01.254ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = be6f557f-d8b4-40a3-b0d5-7cfb45f2354e
150552025-01-30T20:31:01.254ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
150562025-01-30T20:31:01.254ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
150572025-01-30T20:31:01.254ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
150582025-01-30T20:31:01.254ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
150592025-01-30T20:31:01.254ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
150602025-01-30T20:31:01.254ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
150612025-01-30T20:31:01.254ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
150622025-01-30T20:31:01.254ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
150632025-01-30T20:31:01.254ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f
150642025-01-30T20:31:01.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
150652025-01-30T20:31:01.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
150662025-01-30T20:31:01.258ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
150672025-01-30T20:31:01.258ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "062654bc-9a1e-46fc-ae9b-0a708eab7d04", "content-length": "2", "date": "Thu, 30 Jan 2025 20:31:00 GMT"} })
150682025-01-30T20:31:01.258ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
150692025-01-30T20:31:01.258ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b98c7c77-baa6-4f9f-8439-f2470f8c3669", "content-length": "52", "date": "Thu, 30 Jan 2025 20:31:00 GMT"} })
150702025-01-30T20:31:01.258ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch_location = Switch0
150712025-01-30T20:31:01.258ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
150722025-01-30T20:31:01.393ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "97d12856-ffe7-4af1-a3f0-b52157be3402", "date": "Thu, 30 Jan 2025 20:31:01 GMT"} })
150732025-01-30T20:31:01.393ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f switch = Switch0
150742025-01-30T20:31:01.393ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
150752025-01-30T20:31:01.393ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6cd2152b-e0e7-4208-8446-3b1ba878a49f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "48e8c7bd-92cf-4380-976c-6eb01255c364", "content-length": "682", "date": "Thu, 30 Jan 2025 20:31:01 GMT"} })
150762025-01-30T20:31:01.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
150772025-01-30T20:31:01.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
150782025-01-30T20:31:01.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
150792025-01-30T20:31:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
150802025-01-30T20:31:01.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
150812025-01-30T20:31:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
150822025-01-30T20:31:01.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
150832025-01-30T20:31:01.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
150842025-01-30T20:31:01.412ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 609.723892ms iteration = 28 status = {}
150852025-01-30T20:31:01.685ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
150862025-01-30T20:31:01.685ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
150872025-01-30T20:31:01.715ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
150882025-01-30T20:31:01.715ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:60863
150892025-01-30T20:31:01.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60863 req_id = d25dbaa1-2764-441e-9c4d-12639c82a13c roles = RoleSet { roles: {} } uri = /metrics/producers
150902025-01-30T20:31:01.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60863 req_id = d25dbaa1-2764-441e-9c4d-12639c82a13c resource = Database result = Ok(()) uri = /metrics/producers
150912025-01-30T20:31:01.747ZINFOnexus: assigned collector to new producer collector_id = 623434f7-1950-4ff8-a21d-872e401e4248 file = nexus/src/app/oximeter.rs:76 producer_id = 8d5dfa3d-89df-4ed3-89f6-a30554d47abf
150922025-01-30T20:31:01.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32367 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60863 req_id = d25dbaa1-2764-441e-9c4d-12639c82a13c response_code = 201 uri = /metrics/producers
150932025-01-30T20:31:01.747ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d25dbaa1-2764-441e-9c4d-12639c82a13c", "content-length": "41", "date": "Thu, 30 Jan 2025 20:31:01 GMT"} })
150942025-01-30T20:31:01.750ZDEBGnexus (producer-registration-task): registered with nexus successfully
150952025-01-30T20:31:01.750ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
150962025-01-30T20:31:02.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a9eaece2-37b8-4c94-99e7-94f6ab02f12f roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
150972025-01-30T20:31:02.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a9eaece2-37b8-4c94-99e7-94f6ab02f12f resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
150982025-01-30T20:31:02.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a9eaece2-37b8-4c94-99e7-94f6ab02f12f response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
150992025-01-30T20:31:02.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 533 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 1aa127ad-f811-4738-9caa-d5624a3cc8ff response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
151002025-01-30T20:31:03.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0b931c6e-b241-4f30-a603-6603402fe1f6 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151012025-01-30T20:31:03.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0b931c6e-b241-4f30-a603-6603402fe1f6 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151022025-01-30T20:31:03.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 0b931c6e-b241-4f30-a603-6603402fe1f6 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151032025-01-30T20:31:04.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 67c10249-b1ca-4878-9fc0-862897fa3e64 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151042025-01-30T20:31:04.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 67c10249-b1ca-4878-9fc0-862897fa3e64 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151052025-01-30T20:31:04.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 67c10249-b1ca-4878-9fc0-862897fa3e64 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151062025-01-30T20:31:05.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d08b8362-d252-4647-ac3d-62d1abd1a87a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151072025-01-30T20:31:05.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d08b8362-d252-4647-ac3d-62d1abd1a87a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151082025-01-30T20:31:05.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = d08b8362-d252-4647-ac3d-62d1abd1a87a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151092025-01-30T20:31:06.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 75ea29ea-a373-4141-854a-84c08e5baf47 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151102025-01-30T20:31:06.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 75ea29ea-a373-4141-854a-84c08e5baf47 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151112025-01-30T20:31:06.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 75ea29ea-a373-4141-854a-84c08e5baf47 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151122025-01-30T20:31:07.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f7c12c83-d40e-4021-a6b9-8290f44fbb9c roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151132025-01-30T20:31:07.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f7c12c83-d40e-4021-a6b9-8290f44fbb9c resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151142025-01-30T20:31:07.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = f7c12c83-d40e-4021-a6b9-8290f44fbb9c response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151152025-01-30T20:31:08.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5a37e01d-174e-49de-8a05-8df94623edae roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151162025-01-30T20:31:08.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5a37e01d-174e-49de-8a05-8df94623edae resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151172025-01-30T20:31:08.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 5a37e01d-174e-49de-8a05-8df94623edae response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151182025-01-30T20:31:09.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 603f0901-eae4-409c-bf55-b944b8edc024 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151192025-01-30T20:31:09.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 603f0901-eae4-409c-bf55-b944b8edc024 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151202025-01-30T20:31:09.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 603f0901-eae4-409c-bf55-b944b8edc024 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151212025-01-30T20:31:10.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 469937ee-7047-40ee-a066-ef85b7a595cc roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151222025-01-30T20:31:10.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 469937ee-7047-40ee-a066-ef85b7a595cc resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151232025-01-30T20:31:10.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 469937ee-7047-40ee-a066-ef85b7a595cc response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151242025-01-30T20:31:10.801ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
151252025-01-30T20:31:10.801ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
151262025-01-30T20:31:10.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
151272025-01-30T20:31:10.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
151282025-01-30T20:31:10.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
151292025-01-30T20:31:10.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
151302025-01-30T20:31:10.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
151312025-01-30T20:31:10.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
151322025-01-30T20:31:10.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151332025-01-30T20:31:10.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.512094ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
151342025-01-30T20:31:10.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
151352025-01-30T20:31:10.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
151362025-01-30T20:31:10.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
151372025-01-30T20:31:10.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
151382025-01-30T20:31:10.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
151392025-01-30T20:31:10.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
151402025-01-30T20:31:10.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f2e7c9df-cd7e-4c73-938e-a6cc895559ef, lookup_type: ById(f2e7c9df-cd7e-4c73-938e-a6cc895559ef) } result = Ok(())
151412025-01-30T20:31:10.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
151422025-01-30T20:31:10.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
151432025-01-30T20:31:10.854ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef original_time_created = 2025-01-30 20:17:23.656576 UTC target_id = f2e7c9df-cd7e-4c73-938e-a6cc895559ef time_created = 2025-01-30 20:17:23.656576 UTC
151442025-01-30T20:31:10.854ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.033232ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f2e7c9df-cd7e-4c73-938e-a6cc895559ef","time_created":"2025-01-30T20:17:23.656576Z"}
151452025-01-30T20:31:11.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8c0da44b-ff90-48f9-b3c5-055e4f23f10a roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151462025-01-30T20:31:11.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8c0da44b-ff90-48f9-b3c5-055e4f23f10a resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151472025-01-30T20:31:11.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 8c0da44b-ff90-48f9-b3c5-055e4f23f10a response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151482025-01-30T20:31:12.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 37099b42-4670-4ffb-b901-00f210589923 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151492025-01-30T20:31:12.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 37099b42-4670-4ffb-b901-00f210589923 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151502025-01-30T20:31:12.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = 37099b42-4670-4ffb-b901-00f210589923 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151512025-01-30T20:31:12.447ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 556 local_addr = [fd00:1122:3344:101::c]:56425 method = GET remote_addr = [fd00:1122:3344:101::d]:43683 req_id = 9624c7c8-f4ff-46c6-a783-b12bac8642ff response_code = 200 uri = /8d5dfa3d-89df-4ed3-89f6-a30554d47abf
151522025-01-30T20:31:13.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a4074155-faaa-483f-bdf7-c90576251111 roles = RoleSet { roles: {} } uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151532025-01-30T20:31:13.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a4074155-faaa-483f-bdf7-c90576251111 resource = Database result = Ok(()) uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a
151542025-01-30T20:31:13.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:58323 req_id = a4074155-faaa-483f-bdf7-c90576251111 response_code = 200 uri = /probes/80be2cf5-c1f1-42e5-8353-289dd0bb621a